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l. INTRODUCTION 


This thesis addresses the problem of detecting motion of 
an observer above the earth's surface. Specifically, it 
explores ways to detect the motion of an observer by comparing 
two successive images taken by the observer, identifying a 
feature present in both images, and then measuring the 
distance that the feature has moved from the first image to 
the second. The images are two black and white photographs 
converted to digitized images, the basic element of which is 
a picture element (pixel). As long as the observer has not 
rotated between taking two images, comparing the digitized 
images pixel by pixel is easily done, but this brute force 
method of comparing images is not efficient unless a match is 
found on the first scan of each image (best case). In the 
worst case, for example, it would take 800 scans per image and 
1,280,000 comparisons tO compare ae twenty-pixel by 
twenty-pixel image to a forty-pixel by forty-pixel image. 
Therefore, optimization of the comparison is a major part of 
the problem. The idea is to compare only those parts of the 
images that are statistically interesting instead of comparing 


every pixel in one image to every pixel in the other. 


The military has long been interested in automated 
analysis of reconnaissance photographs. Having a computer 
interpret an image eliminates the need to train a human to do 
it. Computers can include image enhancement as part of the 
analysis, bringing out details impossible to detect with the 
human eye. Computers can also detect very small changes in 
successive images; such changes must be significantly greater 
before the human eye can see it. High altitude navigation can 
be aided by a computer that can detect the motion of the 
aircraft over the ground by comparing two successive 
photographs taken by the aircraft. Such a computer Coumie 
accurately and quickly compute speed over the ground. 

Computers have been used successfully to solve various 
Visual problems. A computer can make the precise measurements 
needed for detecting motion. In addition, a computer can 
easily and quickly do any necessary preprocessing of digitized 
images and can quickly compare the statistical information 
gathered by the preprocessing. In particular, a computer 
optimized to work with the language LISP can carry out both 
mathematical computations and list processing very rapidly; 
array processing is also fast in LISP. Fast mathematical 
calculations and fast list and array processing are both 
needed for detecting motion with the techniques presented in 
this thesis. A LISP computer could fit aboard some types of 


aircraft, and any such ground-based computer could be used to 


analyze photographs after the aircraft's mission is completed. 
For these reasons, solving this problem on a computer in LISP 
became the basis for this thesis. 

New ideas used in solving the problem include: 


+ Eliciting two sets of special statistics from each image 
after first finding the gradient magnitude for each 
pixel. The gradient used is the square of the sum of the 
differences between a pixel and its right and bottom 
neighbors; an edge exists at that pixel if the gradient 
magnitude of the pixel exceeds a certain amount (called 
the threshold). The sets of statistics elicited are 
the number of edges in each of the three-pixel by 
three-pixel blocks into which the images are divided, and 
a unique code value assigned each block based on the 
number and position of the edges contained in it. The 
blocks into which the images are divided are not adjacent 
three-pixel by three-pixel blocks but rather overlapping 
blocks--a forty by forty image would contain 1369 such 
blocks; each pixel in the images, with the exception of 
the pixels in the last two columns and rows, is the upper 
left-hand corner of one of these blocks. 


- Searching for a match in the two images by finding two 
points (one from each image) that exhibit the exact same 
values for three different statistics about one feature, 
the edges in the two logical three-pixel by three-pixel 
blocks defined by the two points: the number of edges 
in the three-pixel by three-pixel blocks, the values 
assigned to the blocks based on the positions of the 
edges within them, and the direction and distance of 
these blocks from all other blocks, in their respective 
images, that contain the same number of edges. 


The problem is solved simply, usSing the single feature, 
a few straightforward mathematical calculations, and some list 
processing. The program also automatically chooses’ the 
threshold. In contrast, solutions found by others to similar 
problems require multiple features and human interaction with 
the computer to teach it and to choose the features and 


thresholds to be used. 


The remaining chapters of this thesis explain the program. 
Chapter II is a discussion of related theses that served as 
points of departure for the program and of papers that 
provided insights into techniques used to solve other visual 
problems. Chapter III discusses the various assumptions made 
in’ approaching the problem, expands on the situation that the 
program models, and explains how motion of the observer is 
represented to the program. Chapter IV describes the program 
in some detail. Chapter V discusses the results produced by 
the program. Chapter VI provides the conclusions drawn from 


the results. 


Il. SURVEY OF PREVIOUS WORK 


A. INTRODUCTION 


In sections B and C, some ideas that have been used to 
solve various vision problems are presented. In sections D 
and E, two theses that served as points of departure for this 


thesis are briefly explained. 


B. GENERAL APPROACHES TO COMPUTER VISION 


A convenient way to think of an image is as a function 
giving the gray level at every point on the image plane. Gray 
levels vary from 0 (totally black) to 1 (maximum brightness). 
Since an image surface is two-dimensional, a Cartesian 
coordinate system can be used to assign xX and y coordinates 
to the image surface. The image can be divided into square 
cells, each of which iS assigned x-y coordinates. Each square 
cell is a pixel (short for "picture element"), the image's 
smallest unit of measure. Further, the image can be 
reproduced on a graphics screen by displaying the average gray 
level for each pixel of the image [Ref. l:p. 89]. These 
average gray levels can also be stored in arrays with indices 
that correspond directly to the x and y coordinates of the 


image. 


Vision processing can be divided into two phases: early 
and late. In early vision, a primal sketch is produced. A 
primal sketch 1s a database of data structures, each of which 
describes a feature. Primal sketches contain three kinds of 
features, the most interesting of which is an edge, for 
purposes of this thesis. An edge is a small patch where the 
gray level goes from dark to light [Ref. l:pp. 99-100]. The 
existence of an edge depends on the degree to which the gray 
level changes from dark (0 at the blackest) to light (1 at the 
whitest); that 1s, a threshold may be defined that allows the 
difference between the gray levels of two pixels to be called 
an edge if the difference is only .001, while in other cases, 
the difference may have to be as much as .4 for it to be 
designated an edge. 

It may be that, once a primal sketch iS produced, it is 
not necessary to look at the original image again [{Ref. 1l:p. 
99]. That is the approach tried in this thesis, as it was in 
LT Jean Sando's work [Ref. 2]. Reference 3 describes an 
approach to stereo image matching which also uses only the 
primal sketches produced. The major disadvantage of the 
method described in [{Ref. 2] and that described in [Ref. 3] 
is that human interaction 1S required to teach the computer 


what to extract from the image. 


C. STEREO MATCHING AND MOTION DETECTION 


Stereo matching involves finding corresponding points in 
two slightly different images of the same scene. Since the 
two images are taken from different positions, some points 
visible in one image may be obstructed in the other. 
According to Roman, Laine, and Cox [Ref. 3], 

Most approaches [to stereo vision] may be classified as 
area-based or feature-based. Area-based techniques rely 
on the surface continuity assumption and often involve 
correlation- based matching. Feature-based approaches 
focus on intensity variations that correspond to physical 
and geometric properties and intensity anomalies which may 
not have any physical relevance. Matching is often doneat 
the symbolic level. Much effort has been devoted to the 
study of feature-based techniques because they provide 
better localization and exploit more contextual 
information. [Ref. 3:p. 171] 

They go on to offer an incremental matching strategy, in which 
the user selects features which he thinks stand the best 
chance of being matched successfully. Among the features that 
the user can choose are edge strength, orientation, length, 
and texture; the feature chosen can be used alone to find the 
match or in combination with other features [Ref 3:pp. 
fiai—172). 

Stereo matching is very Similar to the problem addressed 
in this thesis. Both stereo matching and the program 
presented in this thesis try to find matching edges in two 


Similar images. This program is very successful in finding 


matches using one feature only, and it does not require 


interaction with the user. Other research shows that the Game 
technique used to find matching edges in two Similar images 
also can detect the motion of the observer that took "time 


images. 


D. DETECTING ROADS IN AERIAL PHOTOGRAPHS 


The purpose of LT Jean Sando's thesis [Ref. 2] was to find 
roads in an aerial photograph by using texture to identify the 
regions of a digitized image of the photograph. The program 
gathered statistical information that provided evidence as to 
which textures indicated road areas and which textures 
signalled off-road areas. The images had to be divided into 
units, called windows, because texture has meaning only in 
relation to groups of pixels or points. In general, the size 
and shape of windows depends on the size and shape of the 
objects to be identified [Ref. 2:p. 12]. Here, two categories 
of windows were designated. The inner window was the area 
being classified; the outer window was centered on the inner 
window but was larger. To quote LT Sando, 

The three features chosen for this study were the mean 
of the inner window, the variance of the inner window and 
the variance of the outer window. The mean of the outer 
window was not used because early tests indicated the 
results would be virtually identical to the result from 
the inner window mean. The mean of the inner window 
defines the gray level of the window. The gray level is 
important because in most cases there is a distinct 
difference in this feature between the two textures. The 
variance from the inner window defines the granularity, 
or roughness of the window. The outer window is used to 


determine if the granularity varies as the size of the 
Window approaches or exceeds the size of the object, in 


this case the road. These moments were chosen because the 
calculations were relatively simple and they represent 
features that intuitively suggest the different properties 
the human eye might pick out. [Ref. 2:p. 16] 
Each window was identified by using two different methods. 
In the first, each scan window was tested against each of the 
three features separately; if any of the features indicated 
the scan window to be a road area, it was deemed to be a road. 
In the second method, called a Gaussian scan, all three 
features were used together to decide whether the window was 
a road area or an off-road area; in essence, the value of each 
feature in the window added to the evidence until there was 
enough evidence to determine whether a road or off-road area 
was defined by the window. LT Sando concluded that the 
Gaussian scan produced the better results. [Ref. 2:pp. 26-27] 
Using LT Sando's proposition that building up the evidence 
in favor of a conclusion produced more reliable results, the 
program presented in this thesis first finds strong evidence 
that two blocks (one from each image) are the same, based on 
their having the same number of edges within them. Then it 
attempts to confirm the hypothesis by comparing where the 
edges lie within the blocks; if all the edges in one block are 
in the same positions as all the edges in the other block, the 


evidence is strong enough to claim that they are identical and 


represent the same point on the earth's surface. 


E. STATION KEEPING USING BOTTOM-TRACKING SONAR 


LT Chet Hartley's thesis [Ref. 4] was an attempt to solve 
the problem of detecting the motion of an Autonomous 
Underwater Vehicle as it tried to maintain its position over 
a particular spot of the ocean floor, a process known as 
station-keeping. LT Hartley used acoustic signal data instead 
of visual. He stored the results of bottom scans (depth 
information) in arrays. Successive arrays were compared by 
initially laying one on top of the other, center to center. 
Next, the center three-cell by three-cell block (mask) in the 
top image was compared to the center three-cell by three-cell 
block (mask) in the bottom image by finding the difference 
between the value of one of the nine cells in the top image 
mask and the value of the corresponding cell in the bottom 
image mask and then squaring the difference. Specifically, 

(DiGi, yar = (D2 wae (2a) 
where Dl is the top image and D2 is the bottom image, and i 
refers to the corresponding cells in each of the three-cell 
by three-cell masks. This was done for each pair of 
corresponding cells in the two masks. He proposed that if the 
formula produced the smallest square when applied to the 
center cells of the two masks, those cells represented the 
same spot on the ocean floor. Otherwise, the masks were 


shifted and the comparisons repeated until the result of 
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ppplvingetie formula to the center cells of the masks was 
smaller than the result of applying the formula to any other 
corresponding cells. These two cells were considered to 
represent the same spot on the ocean bottom; the distance and 
the direction of the bottom mask's center cell from the bottom 
array's center was the distance and direction that the 
Autonomous Underwater Vehicle had moved between scans. [Ref. 
4:pp. 44-49] 

LT Hartley did not need to collect statistics about both 
arrays. Instead he compared actual cells (depth data), the 
equivalent of comparing gray levels to find a match between 
two digitized images. He also started the comparisons at the 
center of both arrays, a logical idea since his simulated 
Autonomous Underwater Vehicle was centered over the spot 
represented by the center array cells when the scans were 
made. He never had to consider any but the center cells of 
the top array, but in the worst case he might have to look at 
all the cells in the bottom array. All inall, his technique 
was efficient, each set of comparisons consisting only of 


squaring the differences between nine pairs of values. 
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1. DESCRIPTION OF APPLICATION 


A. INTRODUCTION 


Interpretation of aerial photographs came of age during 
World War II, during which 80% of all military intelligence 
was derived from aerial photographs [Ref. 5:p. 217}. Even 
though more than forty years have passed, aerial-photograph 
interpretation remains largely a manual task [Ref. 5:p. 219], 
involving 

..careful comparison of photo coverage over days, weeks, 
and even months; use of stereo vision; measurement of 
images to the tenth part of a millimeter with a high-power 
magnifier fitted with a graticule; and above all, visual 
imaginations (Ref. "636. 63) 

To find the same point in two nearly identical photographs 
taken at the same height involves placing one photo under one 
eyepiece and the other under the second eyepiece and moving 
the photographs until they produce a clear, stereo image. 
Manual measurements can then be taken to determine how far the 


camera moved between photographs. This thesis explores a 


means of automating these procedures. 


B. APPLICATION 


The program presented in this thesis compares two aerial 


photographs taken only moments apart so that both contain a 
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portion of the same scene; then it tries to detect exactly 
where that portion appears in each in photograph and how far 
that portion has shifted from its position in the first 


photograph to its position in the second. 


C. ASSUMPTIONS 


The following assumptions were made: 


- The pictures analyzed have sufficient diversity in gray 
levels for edges to appear; i.e., there should be several 
places in the pictures where the square of the difference 
between gray levels of adjacent pixels is significant. 


- The motion of the observer is in one plane only, a plane 
parallel to the plane of the camera. 


- The light source provides the same amount of illumination 
for two succeeding photographs, making it possible to use 
the same threshold for both images. The threshold is the 
quantity, between 0 and 1, with which the presence of 
edges is detected; i.e., when the square of the 
difference between the gray levels of adjacent pixels 
equals or exceeds that quantity, an edge is present. 

- The relatively small images enable sufficient enough 
testing of the techniques to provide confidence that the 
techniques could be used on larger images. 


- No highly regular, repeated patterns appear in the 
photographs; e.g., parking lots containing many cars. 


- No rotation of the picture frame occurs between the two 


pictures. 


D. SITUATION MODELED 


The program presented in this thesis models the following 
scenario: a photographic system aboard an aircraft takes two 
Successive photographs at a known height and a known amount 


of time apart but close enough in time that both photographs 


ig 5) 


contain the same portion of ground. Digitized representations 
of the two images are processed and compared, and the distance 
traveled by the aircraft 1s determined by how far the portion 
common to both images has shifted from its position in the 


first image to its position in the second. 


E. IMAGES USED 


Figures III-1 and III-2 show the two 500 by 500 images 
that were manipulated to produce the smaller (40 by 40) images 
(also shown) that were used to test the program. The reduced 
images covered the same areas as the 500 by 500 images, but 
in less detail. 

Obviously, Image 1b cannot be compared to Image 2b since 
they have no common ground. But, for testing purposes, each 
image can be partitioned into a pair of images that can be 
compared. The program used this idea to produce two images 


to be compared from a single image. 
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Image 1b 


Figure III-1. First Image Used to Test Program. 
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Image 2a 





Figure III-2. Second Image Used to Test Program. 
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IV. IMPLEMENTATION 


A. INTRODUCTION 


The program is written in Common LISP, in the Symbolics 
Gialect. It runs on a Symbolics LISP machine; in particular, 
it was run on a Symbolics 3675 with five megabytes of memory, 
a Symbolics 3650 with five megabytes of memory, and a 
Symbolics 3640 with 1024 kilobytes of memory. 

Like LT Hartley's program, this program tries to detect 
the motion of an observer over some surface. Also like LT 
Hartley's, it focuses attention on overlapping three-cell by 
three-cell blocks. It uses a formula similar to formula 2.1 
to find the gradient magnitude of each pixel in the images. 
Like LT Sando's program, it tries to solve the problem 
visually, as opposed to acoustically. Also like LT Sando's, 
it creates the primal sketches by doing statistical analysis 
over both images entirely and by starting its scans in the 
upper left-hand corner of the images. However, the features 
in the primal sketches were different from those in LT 


Sando's. 


17 


B. PROGRAM INPUT 


There are three inputs to the program: 

- The name of the file that holds the forty-pixel by forty- 
pixel image that represents the "first" photograph taken 
by the observer. 


- The name of a file if the user wants the screen output 
stored to a file. 


-* The user-chosen x-y coordinate that defines the upper 
left-hand corner of the subimage that represents the 
"second" photograph taken by the observer. 

Note that the "second image is actually implemented as a part 
of the "first" image for test purposes but will not be ina 
real application. From here forward, the "first" image will 
be referred to as the original image (orig-image in the 
program itself) and the "Second" image as the subimage. 
Instead of underwater images as in LT Hartley's thesis, 
this thesis used aerial photographs of different parts of Fort 
Hunter-Liggett, California. Each photograph was digitized 
into a 500 by 500 image and stored in an image file. Because 
processing a 500 by 500 image could be unnecessarily 
time-consuming for test purposes, the files were further 
reduced to forty by forty image files by keeping every twelfth 
column and row of the digitized images, resulting in images 
that are lower-resolution, miniature versions of the original 
500 by 500 images. Each reduced image was placed in its own 
file that could be used by the program. A single file was 


used to produce the two images compared by the program. The 


18 


second image was some twenty-pixel-by-twenty-pixel section of 
the file while the first image was the entire file. The 
program processes the first and second images, extracting 
statistical information about all possible three-by-three 
blocks in the images. The program uses the statistics to find 
pairs of statistically similar blocks in both pictures. The 
difference between the indices into the statistical arrays for 
these blocks yields the offset of the upper left-hand corner 
of the second image from the upper left-hand corner of the 


first image. 


C. PROGRAM OUTPUT 


The output of the program is the registration of the upper 


left-hand corner of the subimage within the original image. 


D. MAJOR INTERACTIONS 


Figure IV-1 is a block diagram that shows the main 
interactions within my program. 

The major high-level function--process images--first calls 
all the preprocessing functions--those that do the statistical 
analyses of the images and store the information in various 
arrays. Function calculate gradient produces a gradient array 
for the original image and one for the subimage. Function 
select threshold uses these gradient arrays to select the 


threshold to be used on both images. Using the threshold, 
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calculate num _edges_and_unique index_numbers produces a num- 
edges-array and unique-index-number array for each image. 
Next, process images calls the primary functions, those 
that do the comparisons and list processing that result in 
finding the registration of the subimage within the original 
image. Function make-edge-list puts into list form certain 
indices into certain arrays. Function find match sends these 
lists to find likely match. If find likely match finds a 
possible match in these lists, it calls compare _unique_ 
index numbers, which looks for even stronger evidence that the 
possible match is a likely match. If that stronger evidence 
is found, find match calls check results; if it is not, 
find match prints a message that says that there were no 


matches in the edge lists. 


E. FUNCTIONS WRITTEN BY OTHERS 


All the functions used to display the images on the 
graphics screen were written by CPT Jim Zanoli, U. S. Army. 


+ make color window produces a window labeled "IMAGE 
ANALYSIS" on the graphics screen when the program is 
loaded. 


* make blue window makes blue the window produced by 
make color window. 


* color pixel is an I/O function that sends’ the 
Red-Green-Blue (RGB) values to a specific pixel on the 
graphics screen. For the purposes of this thesis, the 
RGB values of each pixel are the same, creating gray 
levels that match the gray levels in the black and white 
digitized image. 


Fgh 


- display image can be used to display the image once it 
is stored in an array. 


F. DATA STRUCTURES 


Lists and arrays are used in this thesis. LISP is 
particularly adept at handling and manipulating lists; they 
are LISP's natural data structure. Arrays are the logical 
structure for handling image data. 

There are seven major arrays used in the program: 


- *orig-image-array* 1S ann by n array that holds the gray 
level values of the original image. To save memory, part 
of it also acts as the virtual array that holds the gray 
levels of the subimage. When the program needs to access 
the subimage a, inl order Ee create the 
*subimage-gradient-array*, it 1s actually accessing that 
part of the *orig-image-array* that 1s the subimage. 
This is the only time that the program uses the otherwise 
privileged information as to where the subimage lies 
within the original image; the artificiality of using the 
*orig-image-array* as the subimage's virtual image array 
makes this disclosure necessary. It enters the *orig- 
image-array* at the upper left-hand corner of the 
Ssubimage (the coordinates of that point are an input to 
the program) and processes only those pixels that make 
up the subimage. 


- *orig-image-gradient-array* is an n-1 by n-1 array that 
stores the results of finding the gradient magnitude of 
each pixel in the original image. 


+ *orig-image-num-edges-array* is an n-3 by n-3 array that 
holds the number of edges found in each overlapping 
three-cell by three-cell block a piso: which the 
*orig-image-gradient-array* 1S virtually divided. Every 
*orig-image-gradient-array* cell that has at least two 
neighbors to its right and at least two neighbors to its 
left is the upper left-hand corner of a three-cell by 
three-cell block; therefore, in ann by n image, there 
are ((n-3) * (n-3)) such blocks. The blocks into which 
the *orig-image-gradient-array* and its corresponding 
*subimage-gradient-array* are divided are the units about 
which statistics are gathered and comparisons are made. 
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- *orig-image-index-array* is an n-3 by n-3 array that 
stores the unique numbers representing the three-cell by 
three-cell blocks TA 9 Wis Cane) Ww Dieiec 1h the 
*orig-image-gradient-array* is virtually divided. The 
formula used to compute these unique numbers is described 
in the section entitled PROGRAM COMPONENTS. 


+ *subimage-gradient-array* is a k-1 by k-1 array that 
holds the results of finding the gradient of each pixel 
in the subimage, like the aul ay 
*orig-image-gradient-array* above. k is the length of 
one side of the subimage. 


+ *subimage-num-edges-array* is a k-3 by k-3 array for the 
subimage, like the array *orig-image-num-edges-array* 
above. 


¢ *subimage-index-array* is a k-3 by k-3 array for the 
subimage, like the array *orig-image-index-array* above. 


The program uses four main lists: 
¢ *orig-image-five-edge-list* is a list of the subscripts 
into *orig-image-num-edges-array* whose cells indexed by 
the subscripts yield the number five. These cells 
represent the three-cell by three-cell blocks of the 
*orig-image-gradient-array* that have five edges after 
the threshold is applied. 


+ *orig-image-six-edge-list* is similar to the list 
*orig-image-five-edge-list*, except for six-edge cells. 


- *subimage-five-edge-list* 1s like the leaeSrte 
*orig-image-five-edge-list*, except for the subimage. 


+ *subimage-six-edges-list* 1s like the St 
*orig-image-six-edge-list*, except for the subimage. 


G. PROGRAM COMPONENTS 


The program is divided into the major sections shown in 
the block diagram of Figure IV-1. In addition, there are 


several miscellaneous functions that serve to support the user 
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in better understanding what the program is doing. These 
functions are found at the very end of the program. 
1. Initializing Functions 
Five small functions are in this section. Three, 
described below, must be called by the user--make_image_ 
array, initialize, and set_up. The function set_up calls 
make sub image, and make_image array calls the function 
read file. 
- make image array reads the image file with the help of 
the function read file and stores the gray level values 
in *orig-image-array*. 


- initialize initializes the various global variables used 
in the pregran- 


* set_up calls make _ sub image to assign values to 
*subimage-x* and *subimage-y* and to make sure that a 
subimage that starts at the point defined by *subimage-x* 
and *subimage-y* fits entirely within the original image. 
This error-checking facility ensures that the virtual 
Subimage 1s completely inside the original image so that 
the array subscripts of the virtual subimage will never 
be out of bounds of the *orig-image-array*. 

2. Preprocessing Functions 
These functions carry out the statistical analysis of 
the original image and of the subimage. This statistical 
analysis enables the program to find statistically interesting 
parts of the images to process and compare. Comparing the two 
images pixel by pixel is thereby avoided; the program only 
compares small sections of the images instead. The arrays 


created by these functions are then processed and compared by 


the primary functions, while the original image and the 
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subimage are never looked at again. In fact, the only function 
that actually scans the images is calculate gradient. 

Figures IV-2 through IV-5 are the arrays that hold the 
statistical information about the subimage taken from Image 
1 when *subimage-x* is 5 and *subimage-y* is 10 (i.e., the 
subimage's upper left-hand corner is at the intersection of 
the sixth column and eleventh row of the original image when 
the first row and first column are numbered zero as is the 
convention in computer science). The threshold above which 
the difference squared amongst three neighboring pixels 
produces an edge is .35. The functions that produce the 
arrays and select the threshold are: 

- calculate gradient (size x y gradient-array)--scanning 
the *orig-image-array*, calculates the gradient magnitude 
for each cell in the *orig-image-array* starting at the 
array cell indexed by x and y. The formula used is the 
sum of the square of the differences between the gray 
level of a pixel and two of its neighbors: 

Siepiat (Pia 7 Pi+1,j)° cr (gay = Pi,j-1)°] (4.1) 


where 1 and j take on the values of zero to the number 
of pixels minus one ina row or column (n-1 or k-1, as 


appropriate). Size is the length of a side of the 
Original image (n) or the length of a side of the 
sSubimage (k). x and y are both zero if the image being 


processed is the original image; x is *subimage-x* and 
y is *subimage-y* if the image being processed is the 
Subimage. See Figure IV-2. 


- select_threshold--this function selects the threshold 
that produces as near to m five-edge blocks in the 
subimage aS possible, where m is 2.5% of the total number 
of pixels in the subimage. It tries increments of .1 
until it finds two successive thresholds, one of which 
produces less than m five-edge blocks and the other more 
than m five-edge blocks. Minor interpolation is done to 
fine-tune the threshold as much as possible. The 
resulting threshold is used to preprocess both the 
subimage and the original image. This function calls 
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Figure IV-2. *subimage-gradient-array* for Image 1. 
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d. computation of the value assigned this 
block and stored in the image's index-array 
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Figure IV-3. Computing the Unique Index Value of a Nine-Cell 
Block. 






functions make edge histogram and 
calculate num_edges_and unique index numbers. 


- calculate num_edges_and_ unique index numbers 
(gradient-array size threshold unique-index-num-array 
num-edges-array)--this function produces two arrays for 
each image. For the original image, it produces 
*orig-image-index-array * and 
*orig-image-num-edges-array*. For the subimage, it 
produces *subimage-index-array* ana 
*subimage-num-edges-array*. Starting at the upper 
left-hand corner of the appropriate gradient array, the 
function logically divides the gradient array into 
overlapping three-cell by three-cell block. Each cell 
in the two arrays produced by this function is the upper 
left-hand corner of some three-cell by three-cell block 
in one of the gradient arrays. Those cells in the block 
whose values exceed those of the threshold are flagged 
as edges. The number of edges in each three-cell by 
three-cell block is_ stored in the appropriate 
num-edges-array, indexed by the same indices as those 
that define the gradient array cell in the upper 
left-hand corner of the block. See Figure IV-4. 
Simultaneously, each edge cell in each three-cell by 
three-cell block is assigned a value of 2 raised to some 
power; then the values of each cell in the nine-cell 
block are added together, giving the block a unique value 
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(Figure IV-3). The values for these blocks are stored 
in the appropriate index array (Figure IV-5). 
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Figure Iv-4. *subimage-num-edges-array* for Image 1. 


- make histogram (num-edges-array size)--function 
make histogram is called by function select_threshold to 
find out how many five-edge blocks there are in the 
gradient array of the image in question. The output is 
a list whose values represent the total number of O, 1, 
2, 3, 4, 5, 6, 7, 8, and 9 edges found in the three-cell 
by three-cell blocks into which the gradient array of the 
image in question iS divided. For example, the output 
might look like this for the original onage. 

(475 215 208 230° 149 66) 208Ge ome. 

In this case, the original image has 475 blocks with zero 
edges in them, 208 with two edges, and 66 blocks with 
five edges. Computing the total number of blocks with 
particular numbers of edges in them indicates how many 
blocks hold the number of edges of statistical interest. 
The threshold dictates how many edgeS appear in a 
particular block; by knowing the total number of 
five-edge blocks that a threshold produces, the threshold 
can be adjusted to produce the desired number of 
five-edge blocks. 
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Figure IV-5. *subimage-index-array* for Image 1. 


3. Primary High-Level Function 
This section contains One one finet.on—— 
process images. It calls most of the functions in the program 
and produces status output as various functions are executing. 
4. Primary Functions 
Eight functions make up this section of my program. 


One of the functions calls three of the eight functions, 
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acting as the outer of three loops in the process. The 
functions are: 


- make _edge list (num-edges-array num-edges size)--this 
function returns a list of certain indices into the 
num-edges-array. These indices are the ones whose cells 
hold the num-edges in question (in this thesis, num-edges 
is either five or six). As discussed before, the cells 
of the num-edges-array represent the three-cell by 
three-cell blocks that have five or six edges in the 
appropriate gradient array. 


- find match (subimage-edge-list orig-image-edge-list num- 
edges)--the high-level function process _ images passes 
control to this function, which calls find likely match 
first to look for a match between the two images and then 
function check results to check to see if the match has 
been correctly found. 


- find_likely match (subimage-edge-list orig-image- 
edge-list)--The outer of three nested loops, this 
function loops through the orig-image-edge-list calling 
function second loop until it finds a pattern in the 
orig-image-edge-list that matches the pattern in the 
subimage-edge-list or until it runs out of elements in 
the orig-image-edge-list. The subimage pattern is found 
by subtracting each pair of indices in the 
subimage-edge-list from the first pair of indices in the 
subimage-edge-list. This same pattern 1s looked for 
within the orig-image-edge-list. Note that the pattern 
is based on the first pair of indices in the 
subimage-edge-list and on some pair of indices in the 
orig-image-edge-list. Figure IV-6 shows graphically what 


a matching pattern looks like in the 
etsubimage-num-edges-array* and the 
*orig-image-num-edges-array*. If a matching pattern is 
found, find likely match calls the functiem 
compare unique index numbers, which tries to find more 
evidence that a good match has been found. If a good 


match has been found, find_likely match returns a list 
of the two pairs of indices (one from each edge-1list) 
that produced the matching patterns. If a good match has 
not been found, find_likely match continues to loop 
through orig-image-edge-list looking for another possible 


Nace. 

* second loop (subimage-pattern orig-image-edge-list 
orig-image-pattern orig-key-x orig-key-y)--The middle of 
three nested loops, second loop loops through 


subimage-pattern calling third loop until it has looped 
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Figure IV-6. Matching Patterns of Five-Edge Blocks (in 


Bold Type). 
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completely through subimage-pattern or until it has 
exhausted the possibility of finding a matching pattern 
in the version of the orig-image-edge-list that it is 
working with. 


third loop (orig-image-edge-list orig-key-x orig-key-y 

orig-delta-x orig-delta-y sub-delta-x sub-delta-y) --The 
innermost of the three loops, third _loop loops through 
yet another version of the orig-image-edge-list until it 
finds a pair of indices (orig-delta-x and orig-delta-y) 
in the list that, when subtracted from orig-key-x and 
orig-key-y (a pair of indices peeled off the front 
orig-image-edge-list by find likely match), produce the 
same values as sub-delta-x and sub-delta-y (a pair of 
numbers in the subimage-pattern) or until all pairs of 
indices in orig-image-edge-list have been examined. If 
there is a match, third loop returns a list made up of 
orig-delta-x and orig-delta-y. If there is no match, it 
returns an empty list. 


find pattern (edge-list listlength) --An auxiliary 
function, find_pattern finds a pattern that exists in 
edge-list. The pattern that it finds is the absolute 
value difference between the first pair of numbers in the 
list and every other pair of numbers in the list. For 
example, if the edge-list were: 
Gl 2 BGs eae 
then the pattern would be found as follows: 


il 2 Ht 2 il 2 
-5 -6 ~3 -8 -7 -9 


and the resulting pattern would be: 
(4 4 2 6 6 7) 


compare unique index numbers (sub-image-x sub-image-y 
orig-image-x orig-image-y)--This function looks for more 
evidence that the possible match is the correct match. 
Tt simply compares the value of *subimage-index-array* 
as indexed by sub-image-x and sub-image-y with the value 
of *orig-image-index-array* as indexed by orig-image-x 
and orig-image-y. If the values are the same, it returns 
a list whose contents are sub-image-x, sub-image-y, 
orig-image-x, and orig-image-y. If they are not the 
same, it returns nil. The function is called by function 
find likely match. 
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check results (likely-match num-edges) --Called by 
function find_match, check_results does just that-- 
checks to see if the match found by find_match is indeed 
the correct match. This function will work only when the 
subimage is taken from the original image and therefore 
cannot be used in real applications. 


5. Display Functions 


Tice four “Lunec@lons In this portion of the program 


display the original image on the graphics screen. See 


section E for a more complete description of these functions. 


6. Miscellaneous Functions 


Two functions print arrays so that the user can 


inspect their contents easily; taking certain lists that the 


program sees as lists of independent elements but that are 


logically lists of pairs, two of the functions print these 


lists in their logical form for the benefit of the user; and 


two open and close the optional output file. 


print array (array-name size start-x start-y)--This 
prints the contents of a Square array onto the screen. 


print array file (array-name size start-x start-y 
filename)--Like print array except that the output goes 
to a file instead of to the screen. 


print paired list (list-name)--This prints to the screen 
a list, such as (1 2 3 4), whose contents are logical 
pairs, as ((1 2)(3 4)), so that the user can better 
understand the list. 


print paired list_to output file (list-name) --Like 
function does the same as print paired list except that 
the output goes to the optional output file of the 
program. 


open output file (filename)--This enables the user to 
store the output of the program to a file. 
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- close output file (filename)--This closes the option 
output file opened by open output file. 


H. ERROR CHECKING AND USER FRIENDLINESS 


1. Error Checking 
The only error checking done by the program is to make 
sure that the point in the original image chosen by the user 
to be the upper left-hand corner of the subimage will give a 
Virtual subimage entirely inside the original image. 
2. User Friendliness 
The program was designed so that the user would have 
to call only a minimum number of functions manually. Status 
messages let the user know what processing is being done, so 
that the user is not staring at a blank screen wondering if 
anything is happening. The program also produces intermediate 
results that assist the user in analyzing the results of the 
run. Lastly, names and function names that made sense were 
used, and an attempt was made to write clear documentation for 


each function. 


I. DIFFICULTIES WITH THRESHOLD 


The thorniest problem in this thesis is that of finding 
a good threshold for the images. Without a good threshold, 
either too few or too many edges are produced, and either no 
matches are found or the system stack overflows during the 


list processing loops. Unfortunately, as can be seen in 
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Figures IV-7 and IV-8, the function relating the threshold to 
the number of five-edge cells is not monotonically increasing. 
This is because we are not looking simply at edges but at 
overlapping groups of edges found in the three-cell by 
three-cell blocks into which the two gradient arrays were 
logically divided. Since it was not possible easily to 
predict the behavior of the threshold, the only alternative 
was to limit the number of thresholds tested and pick the one 
that produced the best number of five-edge blocks in the 
subimage gradient array. In a real application, the goal 
would be to find the threshold that produces the best number 
of five-edge blocks in both images. The smaller the number 
of five-edge blocks, the faster the program runs; ideally, the 
number should be no more than 2.5% of the total number of 
pixels in the image. Better approaches remain a matter for 


future research. 
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Figure IV-7. Difficulty in Selecting Threshold for Image 2. 
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Figure IV-8. 
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V. RESULTS 
A. INTRODUCTION 


The program produced better results than was thought 
possible. As can be seen in Figure V-1, as few as two pairs 
of indices in the *subimage-five-edge-list* or the *subimage- 
six-edge-list* were sufficient for the program to find the 
correct location of the subimage within the original image. 
It had been anticipated that possibly as many as five such 
pairs would be needed before the program could identify the 


registration of the subimage. 


B. EXPERIMENTAL PROCEDURES 


Two black and white photographs digitized to two 500 by 
500 images were the basis for the experiments that were run 
with the program. The original photographs can be seen in 
their digitized form in Figures [fi-l! andy... Both ea 
these images were reduced to forty by forty images and placed 
in files. Both Image 1 and Image 2 contain roads, trees, 
bushes, low ground cover, varying shades of dirt, and angles 
cause by meeting roads or borders. In addition, Image 1 
contains a reservoir. Good representatives of relatively arid 
lands, both contain areas of relatively sharp distinction 
between light and dark. Such sharp distinctions may not be 


visible in heavily wooded areas or in flat, cultivated areas. 
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Number of Number of 
5-edge blocks 6-edge blocks 


Threshold *subimage-x* *subimage-y* Result in subimage in subimage 


Image 1 


Image 2 





Figure V-1. Sample Results of Running the Program Without 
Function select function. 


With both image files, experiments were conducted with 
histograms, manually choosing thresholds until fairly good 
thresholds for each image was found. Figure IV-8 shows some 
of the thresholds tried and the effect they had on the number 
of five-edge blocks found in one of the images. 

After workable thresholds were found, the program was run 
eighteen times on each image, uSing various thresholds and 
values for *subimage-x* and *subimage-y*. Figure V-1 shows 
representative results of these runs. Appendix B- shows 
complete results of these tests. 

Based on the results of the threshold work and of the test 
runs of the program, function select threshold was written 
automatically to choose the threshold for the run based on the 
number of five-edge blocks the threshold produces in the 
*subimage-gradient-array*. To test the program at this point, 


it was run on both images using every possible *subimage-x* 
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and *subimage-y* value. The program produced correct results 
on all 800 tests conducted, thus fully proving the correctness 
of the program for these two images. Appendix B shows the 


results of twenty of these tests. 


C. AVERAGE CPU TIMES 


The tests which were run before function select _ threshold 
was added were done on three different Symbolics computers, 
each one with different amounts of memory and different 
processing speeds. On the Symbolics 3675, with five megabytes 
of memory, it took an average of 70 seconds to run the 
program. The Symbolics 3640, with 1024 kilobytes of memory, 
ran the program in an average of 145 seconds, while the 
Symbolics 3650 with five megabytes of memory ran the program 
on the average in So seconds. Adding function 
select threshold slowed the runs considerably. For instance, 
1t took an average of 160.6 seconds to run the program on the 
Svmoolres* 26752 

A few things increased unnecessarily the CPU time needed 
to run the program. The program experiments with both five- 
and six-edge blocks to see if one has an advantage over the 
other. A real system would need only to use one or the other 
kind. Function select _ threshold selects a threshold based on 
the number of five-edge blocks produced; this sometimes has 


the side effect of producing a large number of six-edge 
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blocks, which in turns adds to the processing time. A real 
system could avoid the extra processing by only processing one 
igemnd Of block. Lastly, picking the threshold based on the 
number of five-edge blocks produced in the *subimage-num- 
edges-array* sometimes produces excessive number of five-edge 
blocks in the *orig-image-num-edges-array*; thus, the 
artificiality of extracting the smaller subimage from within 
the original image caused disproportionate numbers of 
five-edge blocks in the original image. This would not occur 
with a real vision system, since it would compare two entirely 
separate and equally-sized images; most likely, the threshold 
chosen for one such image would produce a reasonable number 
of edge blocks in both. 

Another way to speed up the program is to use parallel 
processing, particularly for the functions that cost the most 
in CPU time. Function calculate _num_edges_ and_unique_ 
index values is a good candidate for parallel processing. 
What makes the function time-consuming is that it explores 
every possible three-cell by three-cell block in the 
appropriate gradient array; splitting the gradient array into, 
say, four pieces and assigning each piece to a separate 
processor to explore its three-cell by three-cell blocks would 
probably speed up the function significantly. Function 
select threshold is another function whose CPU time could be 


reduced by parallel processing. This function is time 
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consuming because it calls functions calculate num_edges_ 
and unique index numbers and make_histogram for every 
threshold it considers; to speed up the processing, the 
thresholds to explore could be divided amongst the processors 


available and the results compared later. 


D. ACCURACY OF THE RESULTS 


The program correctly found the registration of the 
subimage within the original image in 100% of the runs in 
which more than one pair of indices were in either the 
*subimage-five-edge-list* or in the *subimage-six-edge-list*. 
In the runs in which there was one or zero pairs of indices 
in the subimage edge lists, the program correctly determined 
that Le could not proceed. After the function 
select threshold was added to the program, there were aqivage 
more than One (Passe seme indices at least in the 


*subimage-five-edge-list*. 
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A. 


VI. CONCLUSIONS 


MAJOR ACHIEVEMENTS 


The program accurately located the same point in two 


images without comparing the images' gray levels pixel by 


pixel. It found the point by comparing the statistics about 


a few interesting points in each image. 


The program demonstrated the practicability of adopting 


its techniques for picture registration determination. These 


techniques are: 


Computing the gradient for each pixel in the image. 


Logically dividing the gradient array into overlapping 
nine-cell blocks. 


Gathering statistics about the overlapping nine-cell 
blocks, specifically, the number of edges in each block 
and the position of those edges within the block. 


Studying only those blocks that contain an interesting 
number of edges--in the case of my thesis, those 
containing five and six edges. 


Looking for a pattern of five-edge blocks or six-edge 
blocks in the original image's num-edges-array that 
matches the pattern of five-edge blocks or six-edge 
blocks in the subimage's num-edges-array. This gives 
strong evidence that the first five- or six-edge block 
in each pattern represents the same point. 


Adding more evidence that the blocks found in the 
preceding paragraph represent the same point by seeing 
if the edges in those blocks are also in matching 
positions inside the blocks. 
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B. WEAKNESSES 


Two of the functions take the lion's share of the 
processing time required to run the program. These are 
select threshold and calculate _num_edges_ and _ unique index_ 
numbers, which may be called by select threshold several times 
before a final threshold is chosen. Even on the fastest of 
the Symbolics computers available to me, calculate _num_edges_ 
and unique index numbers takes one minute of CPU time to 
process a forty by forty array. 

The looping functions find likely match and second loop 
do some redundant calculations in order to preserve the loop 
integrity. A clever algorithm needs to be written to avoid 
the redundancy. This program takes into account changes in 
height of the observer but not rotational movement of the 
observer. Rotational movement of the observer should be 


addressed by future thesis work. 


C. OTHER CONCLUSIONS 


The threshold should be the same for both images compared 
in a run of the program. If this is not the case, edges will 
not necessarily appear in identical spots in the two images 
and certainly not in the same patterns within identical 
nine-cell blocks. Finding the same spot in two images without 
some of the edges in identical places in the two images would 


be impossible using these techniques. Certainly, the 
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threshold will need to change to accommodate changing 
wasibility. 

Focusing the attention of this program on the nine-cell 
blocks that contained five and six edges 1S somewhat 
arbitrary. The program showed that either one of these types 
of blocks produces results if the threshold produces enough, 
but not too many, such blocks. Looking for both five-edges 
blocks and six-edge blocks is redundant and would not be 
needed ina practical application. These were chosen as the 
focus of the program because they appeared statistically 
interesting after some preliminary histogram work. However, 
three-edge blocks and seven-edge blocks are likely to be as 
eligible for use as the five- and six- edge blocks were. In 
fact, one possible way to reduce the time it takes to choose 
a threshold is to hold the threshold constant and select the 
number of edges of interest instead of selecting a threshold. 

Testing this technique on two photographs taken moments 
apart remains to be done. This was not done during this study 
because such photographs were not readily available. Using 
successive photographs presents five problems: FOcCae lon Of 
the observer, translation of the observer, changes in the 
height of the observer, changes in perspective due to the 
observer's translation, and changes in light. The first 
problem is not solved by the technique as presented in this 


thesis; however, it is possible that enlarging the size of the 
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blocks studied would ensure that some edges common in both 
images would appear in corresponding blocks in the two images 
and in the same relative positions within those blocks. 
Further research is needed into this area. The second and 
third problems can be handled by the program as it is 
currently written. As to the changes in perspective due to 
the translation of the observer, it is unlikely that the 
perfect results obtained in these experiments could be 
duplicated using two successive images; their common terrain 
will certainly look different to the computer, however 
slightly, because of the change in angle from the observer to 
the terrain as the observer traveled over it. As shown by the 
results of the experiments conducted in this study, it takes 
only a small number of common nine-cell blocks to appear the 
same in both images in order to obtain a match. Therefore, if 
only a few blocks in each image look the same to the computer, 
a match could be found; but whether even a few would appear 
the same in both primal sketches remains the work of future 
experiments. Changes in light is the last problem presented 
by analyzing two images taken at different times. The 
program's automatic threshold-selection function needs to be 
modified to choose a separate threshold for each image if 
there is a change in light. Acquiring a satisfactory 
threshold for each image does not guarantee that the 


thresholds will produce identical nine-cell blocks throughout 
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the two images; however, it should produce enough to find a 


match. Verifying this hypothesis remains the work of future 


experiments. 


D. SUMMARY 

The results of this thesis show that the techniques 
explored can be used successfully in photo interpretation, 
especially for motion detection. The techniques work very 
well on the reduced versions of Image 1 and Image 2, implying 
that they can be applied successfully to aerial photographs 
that do not contain highly regular, repeated patterns. They 
may work equally well on photographs that do contain such 
patterns, but that type of photograph was not available for 
testing. The techniques would certainly produce good results 
with any photograph that has sufficient changes in gray levels 
from pixel to pixel to produce detectable edges, including 


such photographs of the ocean bottom. 
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APPENDIX A 


PROGRAM 


A. CONVENTIONS USED 


Throughout the program, the reader will find three 
typographical cues. The use of asterisks at the beginning and 
end of an expression signals a global variable (e.g., 
*subimage-index-array*). Local variables (e.g., num-edges) 
and global variables have hyphens, while underscores within 
an expression and verbs identify a function name (e.g., 


calculate num_edges and unique index numbers and initialize). 


B. PROGRAM 


The program is intended to be used in conjunction with a 
graphics terminal so that the user can display the images 
being processed. In order to use the program on a Symbolics 
machine that has no graphics terminal attached, the user must 
delete two of the display functions--make_color window and 
make blue window--and two of the global variable declarations 
near those functions--defvar *color-window* and defvar 
*my-window#*. 

The program processes forty-pixel by forty-pixel images, 
each stored in its own image file. The image files must be 


in the following format: 
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Non-binary. 


The first item in the file must be the length of one of 
the sides of the image; this is so that the program can 
use any square image later on. 


The rest of the items must be the grey level values, from 
zero to one, of every pixel in the image, in row-major 
order from the upper left-hand corner of the image.The 
output is to the screen and, if desired, to an output 
flew The Output CONSIStsS Of; 


1. Messages indicating the x and y coordinate chosen 
by the user and the status of the image 
preprocessing. 

2. *subimage-five-edge-list*--a list of the array 


indices of the *subimage-num-edges-array* cells 
that represent the three-pixel by three-pixel 
blocks which contain five edges. The image 
represented is the subimage. 


3. *subimage-six-edge-list*--a list of the array 
indices of those *subimage-num-edges-array* cells 
that represent the three-pixel by three-pixel 
blocks which contain six edges. Again, the image 
represented is the subimage. 


ae *orig-image-five-edge-list*--a list of the array 
indices of those *orig-image-num-edges-array* cells 
that represent the three-pixel by three-pixel 
blocks which contain five edges. Here, the image 
represented is the original image. 


5. *orig-image-six-edge-list*--a list of the array 
indices of those *orig-image-num-edges-array* cells 
that represent the three-pixel by three-pixel 
blocks which contain six edges. Again, the image 
represented is the original image. 


6. A message indicating: 


a. Whether the program found the correct x-y 
coordinate of the upper left-hand corner of the 
subimage in the original image; if it could not 
find the correct x-y coordinate, why it could 
IDVONE, 
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b. If the program found the correct x-y coordinate, 
whether the program compared five-edge blocks 
or six-edge blocks or both to do so. 

Figure A-1 is an example of the screen output produced by the 
program. Actual file output is contained in Appendix C. 
CAUTION: If the user uses function open output file, he 
must also use the function close output file at the end of the 
run or at the end of the session. If he does not, the file 


will not be closed, and the user will not be able to access 


later 
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(defvar 
(defvar 
(defvar 
(defvar 
(defvar 
(defvar 
(defvar 


Base: 10; Mode: LISP; Syntax: Common-lisp; Package: USER -*- 


*main-screen*) 
*size*) 
*subimage-size*) 
efd*) 

sfd2*) 
*output-file-status*) 
*test-status*) 


= 


(defvar *orig-image-threshold*) 
(defvar *subimage-threshold*) 
(defvar *subimage~x*) 

(defvar “subimage-y*) 

(defvar *orig-image-array*) 

(defvar *orig-image-num-edges-array*) 
(defvar *subimage-num-edges-array*) 
(defvar *orig-image-index-array*) 
(defvar *subimage-index-array*) 
(defvar *orig-image-gradient-array*) 
(defvar “*subimage-gradient-array*) 
(defvar *orig-image-edge-histogram*) 
(defvar *subimage-edge-histogram*) 
(defvar “*orig-image-five-edge-list*) 
(defvar *subimage-five-edge-list*) 
(defvar *torig-image-six-edge-list*) 
(defvar *subimage-six-edge-list*) 


OEP U Ee 


; initializing functions é 
Oe 


part an at aka ncn k eka knee kant n kee eterna a et eta than Katka katte neke ke tkeaehhenkake 
3 Function to read froma file : 
GUA RA KRAAAAARARARKRARKHARAKRARAARARAAKRAKRARAARRARKRAAKRARAAARARARAARARR HARA RR AAD A 
(defun read file (a-stream) 

(read a-stream nil)) 


PR SR SKR REAR AA KARA ARR RK KAA EAR AR AAR EAA A TAA AAR AAA AAW A AE KAR AAA KR A OKA AAA AAA eee 
* Function to make an array that holds the original image a 
pA Aetna e KAKA AK e RA KK AA RKA AAA AARKR ARR TAR AR AAR HARK RAK KARA AR A AR AAA MAAR AR AA AA DH 
(defun make_image_ array (filename) 

(let ((fd nil)) 

{setq fd {open filename :direction :input)) 

(eetq *size*. (read file taj) 

(setq *orig-image-array* (make-array (list *size* *size*))) 

(dotimes (i *size*) 

(dotimes (j *size*) 


(setf (aref *orig-~image-array* j i) (read_file fd)))) 
(close fd))) 


PRT AA RAKRKAKHARARA AAR RRA AA AAA AKA RA AKA HARA RAK AK ARKRAKAARAAKRARAAAAARARAARARAARAAR AAA AR AR AD 
top-level call to "make" a subimage from the original image. 
program tries to figure out where this subimage is, * 

RakRK KA KK HRA RA KK HKRARAKR ATA AKRKRKR AKA RRA KRKRA RA AAT HAHA HAKRA RAK KAKRKRARHAKRKRA KR AKRKRARRAR AR AA RAKRA HARARE KARA 

(defun set_up (xoffset yoffset) 

(make _sub_image xoffset yoffset)) 


Then rest of the = 
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Beet R KKK RRA KARA RA RHA RAR ARKRARHA AKT AKRARRARKRARARA KARA AA AAKRAR RA RA AA RKRAA HAR AR KRAKRAKRA RA A ARK AKAKRAK KK KKRE KE 


a call to this function creates a virtual subimage from the origina) image, with its © 
own known upper left-hand corner. It is intended to be called by the high-leve) function * 
set up to establish the target subimage. From function set_up, xoffset and yoffset are L! 
the desired offsets from the upper left-hand corner of the origina) image; 
returned as *subimage-x* and *subimage-y* respectively. 
of the upper left-hand corner of the new subimage. “ 
Gee AHA RARAHAHTAAAAARRE HATHA ATA KR EAR RK HAAATAARA BARRE SA eee RE ee 
(defun make _sub_image (xoffset yoffset) 
(cond ((and (<= (+ xoffset *subimage-size*) *size*) (<= (+ yoffset *subimage-size*) *size*)) 
(setq *subimage-x* xoffset) 
(setq *subimage-y* yoffset)) 
({or (> (+ xoffset *subimage-size*) *size*) 
(< xoffset 0) 
(> (+ yoffset *subimage-size*) *size*) 


x and y are bs 
They are the x and y coordinates * 
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JRRARAKRAKHHAHAHAHAAKEEHAAHHAHHKHRAKHHAHKRHHHAEHAHAHAHHHAHHARAERARHAHARAHAAHKKKEKAKHKRAARAKRA HEHEHE HHA 
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° 
’ 


GAAAAAAHEREAHKARAAHAKAHAKAAAAHKKKHARAAHAEK AA ABRARAKREAHKERHAAHKKAHHRKEKKHHKEKAKAHKAAHRSEHARARHAKARER 


(< yoffset 0)) 
(pprint “Either x-offset or y-offset, or both, is out of range")))) 


initializes all arrays. 


problem changes. Also initializes *subimage-size* and *output-file-status*, 


(defun initialize () 
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(setq *subimage-size* 20) 
(setg *output-file-status* 0) 
(setg *test-status* 0) 
(setq *orig-image-num-edges-array* (make-array (list (- *size* 3) (- *size* 3))})) 
(setq *subimage-num-edges-array* 

(make-array (list (- *subimage-size* 3) (- *subimage-size* 3)))) 
(setq *orig-image-gradient-array* (make-array (list (- *size* 1) (- *size* 1)))) 
(setgq *subimage-gradient-array* 

(make-array (list (- “subimage-size* 1) (- *subimage-size* 1)))) 
(setgq *orig-image-edge-histogram* ° ()) 
(setq *subimage-edge-histogram* *% ()) 
(setq *orig-image-index-array* (make~-array (list (- *size* 3) (- *size* 3)))) 
(setq *subimage-index-array* (make-array 
(setq *orig-image-five-edge-list* ° ()) 
(setq *orig-image-six-edge-list* * ()) 
(setq *subimage-five-edge-list* ° ()) 
(setg *subimage-six-edge-list* *’ ())) 


preprocessing functions 


ee eee en eee eee eee ee ee eee eee ee 2 ee ee ee ee ee ee ee 28S 
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This function calculates the gradient. Parameters are the name of the image array, the * 
length of one of its sides assuming the array is square, and the name of the array into * 
which the results of the calculations is to be stored. The latter array will be smaller* 
than the image array by 1 in both dimensions. Fills the array with the gradient - 
calculated at each point. Gradient is the square root of the sum of the square of the 
difference between the gray levels of the point and its right neighbor and of the 
square of the difference between the gray levels of the gray levels of the point and 
its neighbor immediately below. Called by function process images. 


(defun calculate gradient (size x y gradient-array) 


ee te Ye te Ge Fe Ye Be Se Be BO 


{dotimes (i (- size 1)) 
(dotimes (j (- size 1)) 
(setf (aref gradient-array j 1) 
(sqrt (+ (expt (- (aref *orig-image-array* (+ j x) (+ 1 y)) 
(aref *orig-image-array* (+ 4 x) + (+ £ 1) y))) 2) 
(expt (- (aref *orig-image-array* (+ j x)(t i y)) 


Intended to be the only section that needs to be changed as the * 


PEERGEEECEE ERATE EEEEEE ER EE LEER ERATE CEEEE EE EE CEE AEEEAEEE EERE EOE AEC CATES EEE EOEETE TEETER TI 


(list (- “subimage-size* 3) (- *subimage-size* 3}})) 


(aref *orig-image-array* (+ (+ 4 1) x) (+ 4 y))) 2)993))) 


This function looks at at the overlapping 9-cell blocks of an array, starting at the 
array’s upper left-hand corner. There is a 9-cel) block at each point; 
9-cell block are the point itself, its two neighbors to its right, the neighbor 
immediatly beneath it and this neighbor’s two neighbors to the right, and the three 
neighbors immediately below those three neighbors. Each cel] in the 9-block array that 
exceeds a given threshold is given a value of 2 raised to x, where x is a number between 


0 and 6 and equates to the ordinal value of the cel) if the cells are numbered from 0 to 86 


from the upper left hand corner. Last, al) these values are added wp and the sum is 


then used to represent the 9-cel) block in an array whose indices also signify the upper 
left hand corner coordinates of the 9-cell block in the original array.’ : 


the members of the 
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(defun calculate num_edges_and_unique_index_numbers 


(gradient-array size threshold unique-index-num-array num-edges~array) 
(let ((temp-array nil) (sum nil) (mum-edges ni)l)) 
(setq temp-array (make-array ‘’ (3 3))) 
(dotimes (i (- size 3)) 
(dotimes (j (- size 3)) 
(setg sum Q) 
(setq num-edges 0) 
(dotimes (k 3) 
(dotimes (1 3) 


(cond ((or (= (aref gradient-array (+ 1 4) (+ k 1)) threshold) 
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(> (aref gradient-array (+ 1 4) (+ k 1)) threshold)) 

(sectf (aref temp-array 1 k) 1)) 

((< (aref gradient-array (+ 1 4) (+ k 1)) threshold) 

(setf (aref temp-array 1 k) 0O))) 

(cond {(= (aref temp-array 1 k) 1) 

(setq sum (+ sum (expt 2 (+ 1 (* 3 k))))) 

(setq num-edges (+ num-edges 1)))))) 
(setf (aref unique-index-num-array j i) sum) 
(setf (aref num-edges-array j 1) num-edges))))) 


PRRAHAAKAAHAARAKKAATAE KARA AHH eee eRe RHR hee nee hhh 

This function selects the threshold to be used throughout a particular run, based on the * 
number of five-edge blocks there are in the subimage’s gradient array. The number of * 
edges found throughout the subimage’s gradient array are stored in *subimage-num-edges- " 
array. If there are not at least 10 five-edge blocks available with the first threshold * 
tried, another threshold is selected. Each time a threshold is selected, calculate_num_ * 
edges _and_unique_index_numbers must be run and an edge-histogram created based on the - 
the results. This process continues until a threshold produces sufficient number of : 
five-edge blocks. The thresholds available to this function are given it in a list called* 
nine-best-list; it contains (.1 .2 .3 .4 .5 .6 .? .86 .9). The function attempts to * 
bracket the goal between the number of five-edge blocks produced by successive thresholds.* 
Once this happens, it tries to get a little closer to the goal by trying either .05 above * 
or .05 below the best threshold so far. Which ever of these produces five-edge blocks 
closest to the goal is the threshold used elsewhere in the program to produce the 
*orig-num-edges-array*, *subimage-num-edges-array*, 
+ *subimage-index-array*. 


° 
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pet anteater Ae hea eae ahaha hehe 
(defun select threshold () 
(let ((lower-bracket 1000) (upper-bracket 0) (goal 10) (nine-best-list nil) 
(edge-histogram nil) (test-threshold nil) (temp-threshold nil)) 
(setq nine-best-list *°(.1 .2 .3 .4 .5 .6 .7 .8 .9)) 
(do ((best-list nine-best-list (cdr best-)ist))) 
((and (< goal upper-bracket) 
(>= goal lower-bracket))) 

(setq temp-threshold (car best-l]1st)) 

(setq upper-bracket lower-bracket) 

(calculate _num_edges_and_unique index numbers *subimage-gradient-array* 
*subimage-size* temp-threshold *subimage-index-array* 
*subimage-num-edges-array*) (princ ™ .“) 

(setq edge-histogram (make histogram *subimage-num-edges-array* *subimage-size*) ) 

(setq lower-bracket (cadddr (cddr edge-histogram) ))) 

({terpri) 
{cond ((= lower-bracket goal) temp-threshold) 
((and (= (abs (- goal lower-bracket) ) 
(abs (- goal upper-bracket))) 
(<= lower-bracket upper-bracket) 
(> lower-bracket 1)) temp-threshold) 
((or (and (= (abs (- goal lower-bracket) ) 
(abs (- goal upper-bracket) )) 
(>= lower-bracket upper-bracket) ) 
(and (= (abs (- goal lower-bracket) ) 
(abs (- goa) upper-bracket) )) 
(<= lower-bracket upper-bracket) 
(< lower-bracket 2))) (- temp-threshold .1)) 
((and (< (abs (- goal lower-bracket) ) 
(abs (- goal upper-bracket))) 
(/= lower-bracket goal)) 

(setq test-threshold (- temp-threshold .05)) 

(calculate _num_edges_and_unique_index_numbers *subimage-gradient-array* 
*subimage-size* test-threshold *subimage-index-array* 
*subimage-num-edges-array*) 

(setq edge-histogram (make histogram *subimage-num-edges-array* *subimage-size*)) 

(cond ((< (abs (- goal (cadddr (cddr edge-histogram)))) 

(abs (- goal lower-bracket))}}) test-threshold) 
((and (= (abs (- goal (cadddr (cddr edge-histogram) ))) 
{abs (- goa) lower-bracket))) 
(<= (cadddr (cddr edge-histogram)) lower-bracket)}) 
(> (cadddr (cddr edge-histogram)) 1)) test-threshold) 
({or (and (= (abs (- goal (cadddr (cddr edge-histogram) ) )) 
(abs (- goal lower-bracket) )) 
(>= (cadddr (cddr edge-histogram)) lower-bracket) ) 
(and (= (abs (- goal (cadddr (cddr edge-histogram) ))) 
(abs (- goal lower-bracket))) 
(<= (cadddr (cddr edge-histogram)) lower-bracket) 
(< ({cadddr (cddr edge-histogram)) 2))) temp-threshold) 
((> (abs (- goal (cadddr (cddr edge-hi stogram)))) 
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*orig-image-index-array*, and the : 
* 
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(abs (- goal lower-bracket))) temp-threshold) )) 
((and (> (abs (- goal lower-bracket) ) 
(abs (- goal upper-bracket))) 
(/= lower-bracket goal)) 

(setq temp-threshold (- temp-threshold .1)) 

(setq lower-bracket upper-bracket) 

(calculate num_edges_and_unique_index_ numbers *subimage-gradiunt ~array* 
*subimage-size* temp-threshold *subimage-index-array* 
*subimage-num-edges-array*) 

(setq test-threshold (+ temp-threshold .05)) 

(calculate _num_edges_and_unique_index_numbers *subimage-gradient-array* 

* subimage-size* 


ee Se fe 


numbers. 


the image 


=e te te te te Te Te TO MO 


statistics. 


appropriate image, 


(cond ((< (abs (- goal 


test-threshold *subimage-index-array* 


*subimage-num-edges-array*) 


(setq edge-histogram (make histogram *subimage-num-edges-array* *subimage-3ize*) ) 
(cadddr (cddr edge-histogram) )) ) 


(abs (- goal lower-bracket))) test-threshold) 


((and (= (abs (- goal (cadddr (cddr edge-histogram) ))) 
(abs (- goal lower-bracket))) 
(<= (cadddr (cddr edge-histogram)) lower-bracket) 


(> (cadddr (cddr edge-histogram)) 1)) test-threshold) 


((or (and (# (abs (- goal (cadddr (cddr edge-histogram) ))) 
{abs (- goal lower-bracket) )) 
(>= (cadddr (cddr edge-histogram)) lower-bracket) ) 
(and (= (abs (- goal (cadddr (cddr edge-histogram) ))) 
(abs (- goal lower-bracket) )) 
(<= (cadddr (cddr edge-histogram)) lower-bracket) 
(< (cadddr (cddr edge-histogram)) 1))) temp-threshold) 
((>= (abs (- goal (cadddr (cddr edge-histogram)))) 
(abs (- goal lower-bracket))) temp-threshold)))))) 


(1.506, 
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This function creates a histogram in which is stored the number of edges that are found 
within each of the nine-cel!} blocks, using num-edges-array as the provider of the 


Num-edges-array is filled by function calculate num_edges_and_ unique_index_ 
Inputs to this function are: 


the name 
the length 
Since there are 10 possible 
convenient data structure. 

the number of O, 
blocks of the image. 


tahoe e eke eee nade at net eee headed tha teeta eka teeta kw ec Ktkateeaekhkakenktandeenane 


the array holding the edge information for the 
st in which to store the edge count, and the size of 
its sides). 
edges in each nine-cell block, an array is not a 
the count is stored in a list whose values represent * 
8, 9 edges, respectively, found in all the nine-cell* 


* «+s + = &= & & 


t 


(defun make histogram (num-edges-array size) 


(let 


(edge-histogram nil)) 


(dotimes 


(cond 


(4 
(dotimes (j 


(= 
(- size 
((= O (aref 
(setq sumOd 
((= 1 (laref 
(setq suml 
((= 2 (aref 
(setq sum2 
((= 3 (aref 
(setq sum3 
((= 4 (aref 
(setq sum4 
((= 5 (aref 
(setq sum5 
((= 6 (aref 
(setq sum6é 
((= 7 (aref 


* (setq sum? 


((= 8 (aref 
(setq sum8 
((= 9 (aref 
(setq sum9 


size 3)) 


3)) 
num-edges-array 
(+ sumO 1))) 
num-edges-array 
(+ suml 1))) 
num-edges-array 
(+ sum2 1))) 
num-edges-array 
(+ sum3 1))) 
num-edqges-array 
(+ sum4 1))) 
num-edges-array 
(+ sum5 1))) 
num-edges-array 
(+ sum6 1))) 
num-edges-array 
(+ sum? 1))) 
num-edges-array 
(+ sumB 1))) 
num-edges-array 
(+ sum9 1)))))) 


((sumO OO) (suml O) (sum2 O) (sum3 0) (sum4 0) (sum5 0) (sum6é 0) (sum? 0) (sumB 0) (sum9 0) 


3 1)) 


a) 


(setq edge-histogram (list sum0 suml sum2 sum3 sum4 sum5 sum6 sum? sumB sum9)))) 


. 
a 

e 
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primar 
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# This function creates a list of x-y coordinates that correspond to the upper left-hand cell* 
s of particular nine-cell blocks in an image. The function looks through the array that * 
+ holds the number of edges found in each nine-cell block of the image and puts in the list * 
# a copy of the x-y coordinates that correspond to the upper left-hand cells of the nine-cel)]* 
+ blocks that have num-edges number of edges. Inputs are the name of the array that holds * 
+ the number-of-edges information about the image in question, the number of edges of * 
+s interest, the size of the image, and name of the list into which to store the results of ® 


+ the function. 


* 
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(defun make _edge_ list (num-edges-array num-edges size) 
(let ((list-name nil)) 
(dotimes (i (- size 3) list-name) 
(dotimes (4 (- size 3) list-name) 
(cond ((= num-edges {aref num-edges~array } 1)) 
(setq list-name {append list-name {list 4 1))))))))) 


FRSASAHATAHAARHAARAHARAAARHAAARRARAAAAHERHHARAHARHEHHHAKEHHAEAAARHARARAAKARAAHEAAKAHHBHK AHA KH ES 
This function is the high-level function that calls three nested loops into action. 
The result of the nested loops is stored in likely-match, which represents the first point 
in the original image that the program thinks might be a match to the point of interest 
in the subimage. This match is based on finding the same number of edges in the nine-ce)) 
block defined by the first pair of array indices in the subimage-edge-list as in the nine- 
cell block defined by the likely-matching point in the original image; and is based on the 
finding the same pattern of five-edge blocks starting at the point defined by the first 
pair of array indices in the subimage-edge-list as the pattern of five-edge blocks starting* 
at the likely-matching point in the original image: and finally is based on these two * 
haveing the same index numbers assigned them in their index-arrays. likely-match may be : 
nil, in which case there is no hope to find a match in the two images. If likely-match * 
is not nil, check_results {1s called. Inputs are the either *subimage-five-edge-list* or ® 
a 
s 
* 
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*subimage-six-edge-list, *orig-image-five-edge-list* or *orig-image-six-edge-list*, 
ts the corresponding number of edges, either 5 or 6. 
grand hhhheRA RHR KARA AARK EA ETRE HAHAHAHA ARHKRAAARARAAAAAAHERAKAaR AKER KAKA KEK ER HHA ARAHEHKHaAK aR AHS 


(defun find_match (subimage-edge-list orig-image-edge-list num-edges) 
(let ((likely-match °% {))) 


{setq likely-match (find likely match subimage-edge-list 
orig-image-edge-list)) 


and 


(cond (f{eq likely-match nil) 
{terpri) 
{(princ "There are no matches in the edge lists") 
{terpri) 
{cond ((] *output-file-status* 1) 
{terpri *fd*) 
(princ "There are no matches in the edge lists” *fd*) 
(terpri *fd*)))) 
{{neq likely-match nil) 
(check results likely-match num-edges))))) 


tana wet en tena ete eee eee hehe watt eh eee tenet othe det the kee eaten ett eehK ee HK KaKKHAKAKKKK KK 


; This function is the outer of three loops. It loops through the orlg-image-edge-list until* 
3 


it finds a pattern in the list that matches the pattern found in the subimage-edge-list. 
If a matching pattern is found, it sets likely-match-list to the result of the function ‘ 
compare unique index numbers. If no matching pattern is found, {it calls itself with the . 
orig-image-edge-list as it was when the first matching pattern was found. If, in the end * 
likely-match-list is nil, it again calls itself with the orig-image-edge-list in its * 
latest state. The function returns likely-match-list, as it eventually exists. * 
Inputs are either *subimage-five-edge-list* or *subimage-six-edge-list* and either *orig- * 
image-five-edge-list* or *orig-image-six-edge-list*. Output is likely-match-list. It * 
Ld] 
a 
* 


t 
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calls functions second loop, compare_unique_index_numbers, and itself. It is called by 
function find_match. ' 


GAARA THHAAKAAAAARAAAREAEAAHHRAREHKEAEKEHARERAAEEAEAHSREHHRS HARARE A AREER ERE 8 8 ee 
(defun find _likely match (subimage-edge-list orig-image-edge-list) 
(let ((subimage-pattern nil) (orig-image-pattern nil) (likely-match-list ’ ()) 
(orig-key-x nil) {orig-key-y nil)) 
(setq subimage-pattern 
(find pattern subimage-edge-list (length subimage-edge-1list))) 
(setq orig-image-pattern 
(do ({orig-image-edge-list-temp orig-image-edge-list (cddr orig-image~edge-1list-temp) )) 
({or (tree-equal subimage-pattern orig-image-pattern) 
(< (length orig-image-edge-list-temp) (- (length subimage-edge-list) 2))) 
(list orig-key-x orig-key-y orig-image-pattern) } 
(setq orig-image-pattern ‘ (0)) 
(setq orig-key-x (car orig-image-edge-list-temp) ) 
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(setq orig-key-y (cadr orig-image-edge-list-temp) ) 
(setq orig-image-pattern 
(second_loop subimage-pattern orig-image-edge-list-temp orig-image-pattern 
orig-key-x orig-key-y) ) 
(setq orig-image-edge-list (cddr orig-image-edge-list-temp)))) 
(setq orig-key-x (car orig-image-pattern) ) 
(setq orig-key-y (cadr orig-image-pattern) ) 
(setq orig-image-pattern (caddr orig-image-pattern)); (pprint orig-image-pattern) 
(cond ((tree-equal subimage-pattern orig-image-pattern) 
(setq likely-match-list 
(compare _unique_index_numbers (car subimage-edge-list) (cadr subimage-edge-1list) 
orig-key-x orig-key-y)} likely-match-list) 
(t (find_likely_ match subimage-edge-list orig-image-edge-list))) 
(cond ((eq likely-match-list nil) 
(setq likely-match-list 


(find_likely_ match subimage-edge-list orig-image-edge-list)) likely-match-]ist) 
(t likely-match-list)))) 


PERERA ARERR EERE A ARERR E TREE A KERR EERE RRR E EERE EERE RHEE ERR REET R EERE ERR 


? This function loops through the subimage-pattern and calls third_loop to look for the same * 
? pattern in the orig-image-edge-list sent it by find_likely match. Inputs are the * 
3 subimage-pattern, a modified version of either *orig-image-five-edge-list* or *orig-image- * 
3 six-edge-list*, orig-image-pattern, and the index values that were car’d and cadr’d off * 
; the orlg-image-edge-list as it exists in find_likely match. It is from these index values * 
3 that the pattern in the rest of the orig-image-edge-list is formed. * 
3 pattern. Calls third loop. * 
BeetA Reta SEA Ake ee eee eee eee EOS he SAN A ee eS ee eee ERE Se RR RRR AR ORE R EKA EKER AERA KR ARERR AERA K KKEe 
(defun second loop (subimage-pattern orig-image-edge-list orig-image-pattern orig-key~-x 
orig-key-y) 
(let ((sub-delta-x nil) (sub-delta-y nil) (orig-delta-x ‘0) (orig-delta-y °’0O) 
(temp-orig-image-edge-list ‘’()})(delta-list ‘' ())) 
(setq orig-image-edge-list (cddr orig-image-edge-list)) 
(setq temp-orig-image-edge-list orig-image-edge-list) 
(do ((temp-subimage-pattern subimage-pattern (cddr temp-subimage-pattern) )) 
((or (nul) temp-subimage-pattern ) 
(null orig-image-pattern)) (cdr orig-image-pattern) ) 
(setq sub-delta-x (car temp-subimage-pattern) ) 


(setq sub-delta-y (cadr temp-subimage-pattern) ) 
(setq delta-list 


(third loop temp-orig-image-edge-list orig-key-x orig-koy-y orig-delta-x 
orig-delta-y sub-delta-x sub-delta-y) }) 
(setq orig-image-pattern (append orig-image-pattern delta-list))))) 


Output is orig-image- 


RAEKRKKA KARR AKHTAR KKAKA RARER DAKE AAT KKK KEE 


The innermost of the three loops, this function loops through the orig-image-edge-list * 


that is passed to it by second loop. It subtracts the first item in the list from ul 


3 

é 

3; orig-key-x and assigns it to orig-delta-x; it subtracts the second item in the list from . 
# Orig-key-y and assigns it to orig-dolta-y. If orig-delta-x equals sub-delta-x and if . 
¢; orig-delta-y equals sub-delta-y, that means that the distance between two array cells in . 
* *orig-image-num-edges-array* is tho same as the distance betweon two array cells in the * 
* “subimag-num-edges-array* and that a matching pattern is emerging from the orig-image-edge-* 
: list. If they are equal, orig-delta-x and orig-delta-y are put into a list, and the * 
; function returns this list. If they are not equal, the function returns the null] list. : 
¢ 


Called by second loop. : 


SSRAHAAAKAAKRKAAKRKKARKKEAHKHKAHKKEHKHABHKKAKKAKHKEBHAKKKHHKKKKAKKEEHKKHKKHKEKKKEEHKHKEKKHEBKKHEE 


(defun third loop (orig-image-edge-list orig-key-x orig-key-y orig-delta-x orig-delta-y 


sub-delta-x sub-delta-y) (let ((delta-list ° ())) 
(do ((temp-orig-image-edge-list orig-image-edge-list (cddr temp-orig-image-edge-list))) 
((or (null temp-orig-image-edge-list) 
(and (= orig-delta-x sub-delta-x) 
(= orig-delta-y sub-delta-y))) delta-list) 
(setq orig-delta-x (abs (- orig-key-x (car temp-orig-image-edge-list)))) 
(setq orig-delta-y (abs (- orig-key-y (cadr temp-orig-image-edge-list)))) 
(setq delta-list (list orig-delta-x orig-delta-y))) 
(cond (({and (= orig-delta-x sub-delta-x) 
(= orig-delta-y sub-delta-y)) delta-list) 
((or (/= orig-delta-x sub-delta-x) 
(/= orig-delta-y sub-delta-y)) ‘’())))) 


KKH RAERAA AREER EAE AAEM EEE KEDAH REECE HARRAH KKK KK 


This function finds a pattern within a list by finding the difference between each pair * 
and the first pair. Inputs are either *subimage-five-edge-list* or *subimage-six-edge- * 
list and the length of that list. It returns the pattern found. . 
SRAAHAARARKAEKAREATARKAAEA AEA THAR HERA AHKRATK ERE HKAEAHAREHKAR HAHAHA RAE EAA RA HAHAH HAAH AHH KAK AHR 


(defun find pattern (edge-list listlength) 


me Me te Me 


oy 


(let ((first-x nil) (first-y nil) (pattern nil)) 
(setq first-x (car edge-list)) 
(setq first-y (cadr edge-list)) 
(dotimes (i (- (/ listlength 2) 1) pattern) 
(setq edge-list (cddr edge-list)) 
(setq pattern (append pattern (list (abs (- first-x (car edge-list))) 


(abs (- first-y (cadr edge-list))))}))}))) 


PAA AGATA AAAAAARARARARAARRARARAAARAARAEARAKRAAARAAKAAAREAAAARAAARAAAAAHARAARRAAKAKKAKRAEH ERR AHHRARRARARAR 
3 This function checks the common edge list areas against the unique number for the 
3 corresponding nine-cell blocks. Those nine-cell blocks with both matching number of edges 
+ and matching unique numbers are then put into a list of lists. Each list within the list 
» 1s made up the x-y coordinate of the subimage nine-cell block and then the x-y coordinate 
x of the original image nine-cell block. No inputs are required. 
PUA AAA AAAAAHAAAAAHAAAAHAAAAAARARARARARARRARKRARAAAARARARAARARAAHARKRHRKRARARARARARARRAHARAREAARHEA ES 
(defun compare _unique_index_numbers (sub-image-x sub-image-y orig-image-x orig-image-y) 
(cond ((= (aref *subimage-index-array* sub-image-x sub-image-y) 
(aref *orig-image-index-array* orig-image-x orig-image-y) } 
(list sub-image-x sub-image-y orig-image-x orig-image-y) } 
(t nil))) 


* 
a 
* 
a 
a 


PRAAAAAAAHHARARAARHEAAHHHEARARAHRARRERARKREKAREKARARAHHHAHARKARAAKHKRARHHAAKRAKRHEAAKAAEAA ESHER ES 


3 This function checks the program’s guess as to the position of the subimage within the s 
» original image, i.e., compares the x-y coordinate of the upper left-hand corner of the a 
» subimage found by the program (and stored in *likely-match-list*) to the actual left-hand * 


corner of the subimage stored in the global variables *subimage-x* and *subimage-y*. : 
GARAREAHREAAAAAEHRAAEKAEEAKHKAERAREREKRAEE RAE RRA RRA RHRAKRRARA RE RARER EERE RE ee Oe eee 


(defun check_results (likely-match num-edges) 
(let (({stars $F RARERARAARARAEREAEAAARARAAKKRAARAARRARAKAREKRHARARARRARAKRARRAERARRARAARAARAAARRAR AR) 


(cond ((null likely-match) 


(terpri) 

(princ “The program has not found the coordinates that correspond to the upper") 
(terpri) 

(princ “left-hand corner of the subimage.*™) 

(terpri) 


(pprint stars) 
(cond ((= *output-file-status* 1) 
(terpri *fd*) 
(princ “The program has not found the coordinates that correspond to the 
upper’ *fd*) (terpri *fd*) 
(princ “left-hand corner of the subimage.” *fd*) 
(terpri) 
(pprint stars *fd*)))) 


(t (cond ((and (= *subimage-x* (- (caddr likely-match) (car likely-match) )) 
(= *subimage-y* (- (cadddr likely-match) (cadr likely-match)))) 
({terpri) (terpri) 
(princ “By comparing nine-block cells with “) 
(princ num-edges) 
(princ “ edges, the program has correctly found ") 
(terpri) 
(princ "that the upper left-hand corner “) 
(princ “of the subimage corresponds to the following ") 
(terpri) 
(princ “x and y coordinates, respectively, of the original image:”) 
(terpri) 
(terpri) 
(princ “ ae) 
(princ *subimage-x*) 
(terpri) 
(prince. = 
(princ *subimage-y*) 
(terpri) 
{(pprint stars) 
(cond ((= num-edges 6) 
(pprint stars))) 
(cond ((= *output-file-status* 1) 
(terpri *fd*) (terpri *fd*) 
(princ “By comparing nine-block cells with “ *fd*) 
(princ num-edges *fd*) 
(princ “ edges, the program has correctly found" *fd*) 
(terpri *fd*) 
(prince “that the upper left-hand corner “ *fd*) 
(prince “of the subimage corresponds to the following ” *fd*) 
(terpri *fd*) 


Sys) 


(princ “x and y coordinates, respectively, 
tfd*) 
(terpri *fd*) 
(terpri *fd*) 
(prince 
(princ *subimage-x* *fd*) 
(terpri *fd* ) 
(princ * “ *fd*) 
(princ *subimage-y* *fd*) 
(terpri *fd*) 
(pprint stars *fd*) 
(cond ((= num-edges 6) 
(pprint stars *fd*))))) 
(cond ((= *test-status* 1) 


(test _ results num-edges))))))))) 


of the original image:* 


“a fd) 


iene ieee yl conccics  g 
primary high-level functions § 
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Shee a eec eee Oe) ee See re ee wee nie en = ee oe ee ee ee ee SSA Se RRA RRA RR ARERR EAA 
: This function calls the other preprocessing functions and decides which are the most * 
+ promising areas revealed by the preprocessing. : 
GRRERAHAAEKKAEARAAHARARAARHARAAHARKARHARAARKARKAARARAAKAAKEARARARAAARERARKHARARAAHARARAAD 
(defun process images () 
(let ((stars F RARAKKARAARERARAARARARAAARARARARARARARARARKRARKKRARAAAAKRARARARAARARARAARARKRARARARRARK) } 
(terpri) 
(princ *subimage-x*) 
(princ " and “) 
(princ *subimage-y*) 
(princ “ are the x and y coordinates of the original image point") 
(terpri) 
(princ “that is the upper left-hand corner of the subimage.") 
(terpri) (terpri) 
(princ “running calculate gradient on the original image”) (terpri) 
(calculate gradient *size* 0 0 *orig-image-gradient-array"*) 
(prince “running calculate gradient on the subimage") (terpri) 
(calculate gradient *subimage-size* *subimage-x* 
(princ “running select threshold") 
(setq *subimage-threshold* (select threshold) ) 
(setq *orig-image-threshold* *subimage-threshold*) 
(princ “running calculate _num_edges_ and unique index_numbers on the original image“) (terpri) 
(calculate num_edges_ and unique index_numbers 
*orig-image-gradient-array* *size* *orig-image-threshold* 
*orig-image-index-array* *orig-image-num-edges-array*) 
(princ “running calculate _num_edges_and_ unique _ index _numbers on the subimage") (terpri) 
(calculate num_edges_and_ unique _index_numbers 
*subimage-gradient-array* *subimage-size* 
*subimage-num-edges-array*) 
(terpri) 
(princ “The threshold for this run is ") 
(princ *subimage-threshold*) (princ ".") 
(terpri) (terpri) 
(princ “*subimage-five-edge-list*:") (terpri) 
(setq *subimage-five-edge-list* 
(make edge _ list *subimage-num-edges-array* 5 *subimage-s3ize*)) 
(print paired list *subimage-five-edge-list*) (terpri) (terpri) 
(princ “*subimage-six-edge-list*:") (terpri) 
(setq *subimage-six-edge-list* 
(make edge list *subimage-num-edges-array* 6 *subimage-size*) ) 
(print_paired list *subimage-six-edge-list*) (terpri) (terpri) 
(princ “*orig-image-five-edge-list*:") (terpri) 
(setq *orig-image-five-edge-list* (make edge list *orig-image-num-edges-array* 5 *size*)) 
(print paired list *orig-image-five-edge-list*) (terpri) (terpri) 
(princ "*orig-image-six-edge-list*:;") (terpri) 
(setq *orig-image-six-edge-list* (make _edge list *orig-image-num-edges-array* 6 *size*)) 
(print paired list *orig-image-six-edge-list*) (terpri) 
(pprint stars) 
(cond ((= *output-file-status* 1) 
(terpri *fd*) (terpri *fd*) 
(princ *subimage-x* *fd*) 
(princ “ and ” *fd*) 
(princ *subimage-y* *fd*) 


(princ “ are the x and y coordinates of the original image point" *fd*) 
(terpri *fd*) 


*subimage-y* *subimage-gradient-array*) 


*subimage-threshold* *subimage-index-array* 
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(princ “that is the upper left-hand corner of the subimage.” *fd*) 
{terpri *fd*) (terpri *fd*) 
(princ “running calculate gradient on the orig-image“ *fd*) (terpri *fd*) 
(princ “running calculate_gradient on the subimage”“ *fd*) (terpri *fd*) 
(princ “running select _ threshold” *fd*) (terpri *fd*) 
(princ “running 
(terpri *fd*) 
(princ “running calculate _num_edges_and_unique_index_numbers on the subimage“ *fd*) 
(terpri *fd*) (terpri *fd*) 
(princ “The threshold for this run is “ *fd*) 
(princ *subimage-threshold* *fd*) 
{pring <*.> *td*) 
(terpri *fd*) (terpri *fd*) 
(princ “*subimage-five-edge-list*:“ *fd*) (terpri *fd*) 
(print_paired list_to output file *subimage-five-edge-list*) 
(terpri *fd*) (terpri *fd*) 
(princ “*subimage~six-edge-list*:" *fd*) (terpri *fd*) 
(print _paired list_to_output_file *subimage-six-edge-list*) 
({terpri *fd*) (terpri *fd*) 
(princ “*orig-image-five-edge-list*:"* *fd*) (terpri *fd*) 
(print paired _list_to_output_file *orig-image-five-edge-list*) 
(terpri *fd*) (terpri *fd*) 
(princ “*orig-image-six-edge-list*:" *fd*) (terpri *fd*) 
(print _paired_list_to_output_file *orig-image-six-edge-list*) (terpri *fd*) 
(pprint stars *fd*) (terpri *fd*))) 
(cond ((> (length *subimage-five-edge-list*) 2) 
(find match *subimage-five-edge-list* 
((eq *subimage-five-edge-list* % ()) 
(terpri) (terpri) 
(princ “There are no five-edge blocks in the subimage.”*) 
(terpri) 
(pprint stars) 
{cond ({(= *output-file-status* 1) 
{terpri *fda*)(terpri *fa*) 
(princ “There are no five-edge blocks in the subimage.” *fd*) 
(terpri *fd*) 
(pprint stars *fd*)))) 
((= 2 (length *subimage-five-edge-list*)) 
{terpri) (terpri) 
(princ “There is only one five-edge block in the subimage.”) 
({terpri) 
{pprint stars) 
(cond ((= *toutput-file-status* 1) 
{terpri *fd*) (terpri = fa*} 
(princ “There is only one five-edge blocks in the subimage." *fd*) 
(Carpe! *fa=) 
(pprint stars *fd*))))) 
(cond ((> (length *subimage-six-edge-list*) 2) 
(find match *subimage-six-edge-list* 
((eq *subimage-six-edge-list* * ()) 
(terpri) (terpri) 
(princ "There are no six-edge blocks in the subimage.") 
(terpri) 
(pprint stars) (pprint stars) 
(cond ((= *output-file-status* 1) 
(terpri *fd*) (Cerpri *fd*) 
(princ “There are no six-edge blocks in the subimage.” *fd*) 
{terpri *fd*) 
(pprint stars *fd*) (pprint stars *fd*)))) 
((= 2 (length *subimage-six-edge-list*)) 
{terpri) (terpri) 
(princ “There is only one six-edge block in the subimage.") 
(pprint stars) (pprint stars) 
{cond ((= *output-file-status* 1) : 
(terpri *fd*) (terpri *fd*) 
{princ “There is only one six-edge block in the subimage.”“ *fd*) 
(pprint stars *fd*) (pprint stars *fd*))))))) 


calicualte_num_edges_and_unique_index_numbers on the original image" *fd*) 


*orig-image-five-edge-list* 5)) 


*orilg-image-six-edge-list* 6)) 
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The following functions can be used to display the images. These functions are modified J 
versions of Jim Zanoli‘s functions. His comments are included. i 


aetna keeeee et etece etna keak eee et eananeknaketadwanaAt eee eet ene ee eee eee eee t eee tna kaeteanatakean 


make color window creates an empty window on the color graphics display. * 
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6 CROV CCE PP CCC SESE ESE AL PL TL SN SAT MS aera SE Bie alle 
(defun make_color window 
(frest options tkey (superior (color:find-color-screen : create-p t)) 
Callow-other-keys) 
(apply @’tvsmake-window ‘’tv:window 
tblinker-p nil 
tborders 2 
rsave-bits nil 
sexpose-p t 
s:default-character-style 
"(:fix sbold :large) 
tlabel “IMAGE ANALYSIS” 
:superior superior 
options) ) 


(defvar *color-window* (make color window) ) 


pele eie ee eee Se ee ee ee eee ee ee ee ee eee ee eee ee ee eee 


# make blue _ window creates a blue window on the color graphics display : 
(CY CSUE EES CTS CT MI ELE ELLs eta li lle 


(defun make_blue_ window (&rest options) 
(setf *main-screen* (send *terminal-io* s:superior) ) 
(apply #‘make_color_ window 
rerase-aluf (send color:color-screen 
scompute-color-alu 


tvzsalu-seta O 0 0.5) 
options) ) 


(defvar *my-window* (make blue window) ) 


Rake aekkeacekekkcke kaa kek ka kk eee wank eank ee Ke aK Kae KRHA H RRR ARKH RRAKRKRARARTHTA KRHA Kae Kha aa RK 


color-pixel colors a pixel with the inputted x and y coordinates in the color indicated by* 
the inputted shade " 


Zee ed daw e eee ae KAS AKEAARAEAAAAAAAEAREKRAEHAKRARERARAKRAAATREKAKKEKRAKKEKARHAKAKKAAKAaRHAKARAKARAAGK ERE 
(defun color _ pixel (xcoord ycoord shade) 
(send *my-window* s:draw-point xcoord ycoord shade) ) 


wee Be te 


g RR AR RARER AAEKKEKKEAR KAKA KEAAK AA KKAARARKARKAEAAK KA KKK ER AK EKA RAK ARR AK 


; display image draws the picture that is represented by the array \s 
GRR ARAHRRARARREAAHEAHKAAAHRAAARRHHAARAARHAKAREKRKKERHKERKAKRARKE HA AHAHERAA ER RE 
(defun display image (array-name x y size) 
(let ((b&w-color nil)) 
(dotimes (row-number 3ize nil) 
(dotimes (col-number size nil) 
(setq bkw-color (aref array-name col-number row-number) ) 
(color pixel (+ x col-number) (+ y row-number) (send (send *my-window* : screen) 
:compute-color-alu color:alu-x béw-color béw-color b&w-color)))))) 


? 
. miscellaneous i 
: 


Bakke anwkkao keke kkk kek ke kee kee K HEH EEAHKERAHT AKHTAR HKD KRKEAKRH KKH Ke 


With this function, the user can print an array to the screen. Inputs are the array name, * 


: 
: 
z the length of one of its sides (it must be square), and the indices into the array for . 
: the point at which the user wants the display to begin. * 
ZR RAK RRR RRR A RRA RAER AAA RReehe a 


(defun print_array (array-name size start-x start-y) 
(dotimes (i size) 


(terpri) e 
(dotimes (4 size) ‘ 


(princ (aref array-name (+ start-x 4) (+ start-y i))) 
(prince “ “)))) 


Keke kaa ea KKK KER HA Ka KKR KA Kaa eee Kea KKK KKK KR KK aH Kaha Kah Kee eK HK ATH aa aTKe eae ke KKK 


; 
; With this array, the user can print an array to a file. The inputs are the same as to * 
; 


function print_array except for an extra one, which is the name, in double quotes, of the * 
in which to store the array. « 


pe AeA ee RA AAR RAR AERA REAR A REE RE ER ARREARARRERAARRKAEREAAAARARREAA RE A RE REKKKA 


(defun print_array file (array-name size start-x start-y filename) 
(let ((fd nil)) 


(setq fd (open filename :direction :output)) 
(dotimes (i size) 
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(terpri fd) 
(dotimes (j size) 
(princ (aref array-name (+ start-x j) (+ start-y i)) fd) 
(prine " “ fd) )) 
(close fd))) 


FRRARnaRAATHK KH KHKHKHHHHKHHHRKHKAKKAKRKA KAR KARR ATK HHH HERR KRHA ARK 
This function does a pretty print of a list that is logically a list of paired lists, 
that the user can more readily understand the list’s contents. 
¢ name. Called by function process _ images. a 
PSSaeaARKA KH AKA KTAKKRHAHKRKKKKHKHKKKAKRKHHKHKH AHH KRES HHH HHH KH KKH KKK HEHEHE HHH RHEE HEH 
(defun print_paired list (list-name) 
(let ((paired-list ‘ ())) 
(dotimes (1 (/ (length list-name) 2)) 
(setq paired-list (append paired-list (list (list 
(setq list-name (cddr list-name))) 
(princ paired-list))) 


so* 
Input is the list’s * 


; 
é 


(car list-name) (cadr list-name))))) 


FREAAAARARKAERAAHHARAAAAHAAAAARAAHA KRHA ARKH H HH RARHARHAHAKKAHHRH EHH HHH K KERTH R HERE 


* This function does a pretty print of a list to the user’s output file. 


Called by « 
s process images. 


* 
PAAR ee KARA AHHH HARRAH HAAR A AHHH AAAHARHRA AHHH ARKHKAHAAK EHH H EHH H KKH Kae eH 


(defun print_paired list_to_output_ file (list-name) 
(let ((paired-list °’ ())) 
(dotimes (i (/ (length list-name) 2)) 
(setq paired-list (append paired-list (list (list 
(setq list-name (cddr list-name) )) 
(princ paired-list *fd*))) 


(car list-name) (cadr list-name))))) 


FAAAAHHSAHAHAHRAAHAAHKAARAKARKRARKKAKKHAHARKAKRARAHAHAARRKAAKKHKAHRARHERHHKHKARKRKEKRKK KAKA HRS KE SERS 
This functions enables the user to store the output of the program to a file, 
by the user, it has one input, 
the output. 


Called s 
the filename of the file in which the user wants to store * 
If the user uses this function, he must also use function close output file* 
before logging out, or the output file will remain open and inaccesible. Setting * 
*output-file-status* to 1 lets the functions that produce output know to send output to * 
to the output file. Only one file may be open during any one run of process images. : 
PRAAAARAAKAKRAAAKAAKAAAAAAH KARR AAKARAAAARHAKRAHKRKARHARARHKHARKKAERHAKARARAARARRAKAAK RRA KKEH RHE 
(defun open_output file (filename) 

(setq *fd* (open filename :direction s:output) ) 

(setq *output-file-status* 1)) 


=e ese Se fel CF 


RaRKKRKHKHAaARKAKRHEHAARATH HAH HHH HAKKAR AHHH HRA HHH HAHAH HHH HA HHH eA KK KKH HA KAKA K aKa KR HeE 
This function closes the output file. Called by the user, 
& run or at the end of the session. Input is *fd*, 
the name of the output file. 


it can be used at the end of * 
the variable that takes on the * 


i] 
RRR KHER KRKRKEK KEKE HT KRHKKKRA AT KRAKRAA HRA KAA KKAKRARAAKAAKAKAHAAKAAKAHKRHAKR KKH K KA KRKRKAKKKAKRAKR AKA AKA KRAKRA KAKA KKK KKK KEK 


(defun close output file (filename) 
(close filename) 


(setq *output-file-status* 0)) 


ee Ge Se Be Ge 


BkeateteaeeeaeneaKK HK KA KKH AKTKAR AKA RA KKRAA KH KRKAKRAKAAKKAEA KAKA AHKKRHEKRARKRKHKAA AA HTAAAK KAA KKK ARAAAKRARARKRARREAR 


These functions test the program on every possible point in the original image. 
complete test is called by the user; x and y are the coordinates where the test is to . 
begin, ideally 0 and O. test results is called by function check results, that is, it 


called only if the program succeeds in finding the correct coordinates of the upper 
left-hand corner of the subimage. 


se te Te Ge Ge FS FO 
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RRA KAKA RHKAKRARAAAAKAKKRAKRAEA KAA KA AKRAKRAKRAKAAAKHAABAAAARKRAAKAHKRKRAKRAKR KAR AKRAKRA AAR HAKKAR KEK KR AK HK KA KRHK EK HKKHKR 
(defun complete test (input-fllename x y output-filename) 


(setq *fd2* (open output-filename :direction :output)) 
(setq *test-status* 1) 


(make image array input-filenama) 


(initialize) Uy 
(do: ((l°y (+ 1. 1))) 
((= 4 21)) 
(do ((j x (+ j 1))) 
((= J 21)) 


(set_up j i) (terpri *fd2*) 
(princ “Subimage-x*: ” *fd2*) (prince j *fd2*) (prine ~ *subimage=y*: ~ *fd2*) 
(prine 1 *fd2*) 
(process images) )) 
(setq *test-status* 0) 
(close *fd2*)) 


(defun test results (num-edges) 
(terpri *fd2*) 
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(princ 
(princ 
(princ 
(princ 


“The program found *subimage-x* to be “ *fd2*) (princ *subimage~x* 
" and *subimage-y* to be “” *fd2*) (princ *subimage-y* 
num-edges *fd2*) (princ “ edge blocks. “ *fd2*) 

“Threshold was “ *fd2*) (princ *subimage-threshold* *fd2*)) 


“bd2 *') 
*fd2*) (princ * using * *fd2*) 


ae 


APPENDIX B 


RESULTS OF SELECTED TESTS 


Without function select threshold: 


Number of Number of 
\-edge blocks 6-edge Dil@@iae 


Threshold *subimage-x* *subimage-y%* Re stint in subimage in subimage 


Image l 
Be 8 17 match 9 0 
Bee @) 8 matches 14 4 
a) 10 10 matches 9 4 
ae 2 16 match es 0 
Pe 18 18 match 3 @) 
poe 2 16 match 9 @) 
Meo, S 5 matches 8 9 
oD 10 me) match 5 0 
Beets 0 3 matches 6 Z 
oe 20 20 no match il 0 
Bab Se 10 26 Mateh 8 @) 
Ree) alee, 18 match 8 0 
Bs @) 20 match 8 ih 
4 i? 18 match 8 0 
4 5 5 matches 5 2 
a4 10 10 match 8 0 
4 20 20 no match il @) 
.4 8 se, match D O 
Image 2 
Pails 0 ie match 4 1 
mies 8 2 matches 19 4 
Soles. @) @ matches ile: 6 
silks 20 20 match 14 0 
me les @) Z matches 6 . 
Pyles 20 0 matches 33 19 
Pe A ee. 5 4 matches 6 3 
mleY 2) ee 20) match 3 0 
ae gs. @) 20 match 2 0 
Ree ae 20 20 match 4 @) 
Me yas: 3 8 matches 8 2 
eS 10) 8 matches 6 3 
ES sls: ily no match 0 @) 
mays) 0 ibe match 2 0 
2 5 5 ma ten 2 @) 
ae @) 20 no match @) @) 
a2 8 3 match 2 @) 
a! ile 0 match 3 0 
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Hethetunctton select threshold: 


Number of Number of 
D-edge blocks 6-edge blocks 


Threshold *subimage-x* *subimage-y* Reswit in subimage in subimage 


Image 1 
as 19 @) matches i 5 
6) 20 20 matches Is. 2 
5) ile 1 matches I) Z 
3) 5 5 matches 8 9 
oie, 2 16 match 9 0 
5) 10 10 matches 9 4 
os 0 3 matches ipa 7] 
4 0 20 match 8 il 
us 10 20 match 8 0 
met 12 18 match 8 0 
Image 2 
oll les eS matches 20 18 
Sis > 5 matches le 14 
Alle: 0 Ie match 4 iL 
> 19 19 match Wa 0 
m5 19 8 matches 14 6 
Ses: ital 20 match 14 0 
5 0 0 matches Pe 6 
ys, 20 Jeg matches 8 2 
rd 8 5) match 2 0 
2 i 0 match 3 @) 
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APPENDIX C 


SAMPLE RUNS 


5S and 5 are the x and y coordinates of the original image point 
that is the upper left-hand corner of the subimage. 


running calculate gradient on the orig-image 

running calculate gradient on the subimage 

running select _ threshold 

running calcualte_ num_edges_and_unique _index_numbers on the original image 
running calculate _num_edges_and_unique_index_numbers on the subimage 


The threshold for this run is 0.35. 


*subimage-five-edge-list*: 
{(2. 2) (4 3) (3 4) «(6 4) (EY 10) (10 Taree 6) Soe re 


* subimage-six-edge-list*: 
((2 2) (3 2) (4 2) (2 4) 44 4) (12 Bye 11 eee 


*orig-image-five-edge-list*: 
((13 3) (12 4) (14 4) (6 7) (9 8) (8 9) (11 9) (16 15) (30 16) (3 19) (2 15) (Cee 


(14 21) (175 21) (13 22) (14 22) (26 22) (12 23) (13 23) (0 26) (0 28) (12 33); ee 
(26.33) 42°35) “(2 Sicwisesc)) 


*orig-image-six-edge-list”*: 
{¢7 7) (8 7) (9 7) (7 9) 09°98) (16 13) (17 13) (16 14) ei) 


RWKWHEERERR RRR KKK RARER KK RR KK ERR AERA RAR RRA KR KARR RA RH ARR AKA RR KERR ARR KE 


By comparing nine-block cells with 5 edges, the program has correctly found 
that the upper left-hand corner of the subimage corresponds to the following 
x and y coordinates, respectively, of the original image: 


S 
5 


oe ee ee ee oe ee ae ee a a a oe ee a a a a a ee oe a a a Oe ee 


By comparing nine-block cells with 6 edges, the program has correctly found 
that the upper left-hand corner of the subimage corresponds to the following 
x and y coordinates, respectively, of the original image: 


Ss, 
2) 


ARK RRR KR KAKA AK REAR ARR RRR RRR RAKE RRR HARARE RRR RRA RRR REE 


ae ee oe a oe oe oe ee oe ee ee ee a oe a a oe a a a a ee ee ee ee ee 


19 and O are the x and y coordinates of the original image point 
that is the upper left-hand corner of the subimage. 


running calculate gradient on the orig-image 
running calculate gradient on the subimage 
running select threshold 


running calcualte_num_edges_and_unique_index_numbers on the original image 
running calculate_num_edges_and_unique_index_numbers on the subimage 


The threshold for this run is 0.25000003. 


*subimage-five-edge-list*: 
{(O 11) (7 11) (4 13) (2 15) (3 15) (45S eee 


*subimage-six-edge-list*: 
((3 14) (4 14) t2 16) (10 16) ties) 


66 


*orig-image-five-edge-list*: 
(0070)? (P02) (13 2) (10: 3) 
pore) (8 8) (5° 9)) (11 9) 
(9°13) (1G 13)- (13 13) 
(Pa Teele?) £18" 17) 
(13518) [G7 18). (185158) 
ie 20) (2 21) (15 21) 
CU 24) ei2 24) (25°24) 
(26 27) (3 28) (26 28) 
(26 32) (32 32) (36 32) 
(i235) (35 35) (26 36) 


(122) 
(7 10) 
(237-03) 
(19°17) 
(24 18) 
(12-22) 
(O° 25) 
(34 29) 
(22 33) 
(27 36)) 


(13.3) 
(8 10) 
(70 14) 
e2ae 7) 
(34 18) 
(26 22) 
(4 25) 
(O 30) 
(1 34) 


(14 4) 
(6 11) 
(18 14) 
(23 17) 
(36 18) 
(27 22) 
(2) 20) 
(34 30) 
(11 34) 


(7. 5) (9 5) 
Coy 1921) 
(2% Vo) 
(36 17) 
(a9) 


(865) (9 6) 
(26 11) 
(22.1°5)) 
(O 18) 
(6 19) 
(32 22) (36 22) 
(7225) (4 26) 
(36 30) 
(21 34) 


(10 6) 
(8 22) 
(23 19) 
(1 18) (6 18) 
Coes 2. 19)) 
(12 23) 
(5 26) 
yi? 31) 

(22 34) 


(O 7) 
C242) 
(20 16) 


(10 7) 
(YS 12) 
fOr): (13. 17) 
(7. 18) (12 18) 
(19520) (17 20) 
(13°23) t25 23) (0 24) 
(S926) (Ss 27%) (25-27) 

(dea; 3d) 32°31) “24 32) (25 32) 
(23 34)) (247534), 428 34) (1 35) 


*orig-image-six-edge-list*: 
CU) Oj 10), (1t 1) (12 2) 
(ocr? Lil) (Ler a) 
Cu6 515) (17 15) (21 sie} 
(36 19) (16 20) (35 20) 
(irae?) (295 622) °0~«6(0: 626) 
fee o2) F135 32) (la 33) 


(10 4) 

(iy 12) 
(29 16) 
(36 20) 3(14 21) 

(7e 26) 91 27) 
(23 33) 


(6 5) 
(Cine 13) 
(30 16) 


(10 5} 
(12-3) 

(8 18) 

(32° 2) 
(25279) 
(27 933) 


(11 5) 
(16 13) 
(25 18) 
(33 21) 
(12 27) 
(3 34) 


(627). (777) 
(ES 13) (13 14) 
(ieee) (2 919) 
(34 21) 
(029) 
(13 34) 


(9 6) (10 9) 
(16 14) 
(16 19) 
(35 21) 
(229) s(1 30) 


(25935)>. (26: 35) 


(9 10) 
(22 14) 
(17-19) 
(36 21) 
(34 31) 
(27 35) 


(Pal) 
(23 14) 
(35 19) 
(i322) 
(36 31) 
(3736) (25. 36)) 


KREMER KKK KKK KK KKK KARR KKK KEKE KEKE KEKE KEKE KKK ARK KKK 


By comparing nine-block cells with 5 edges, the program has correctly found 
that the upper left-hand corner of the subimage corresponds to the following 
x and y coordinates, respectively, of the original image: 


a9 
0 


RK KEKE KEKE KKK RRR EK KKK KKK KEK KKK KKK KKK KEKE K KEKE KKK KKK KK KKK KKK 


By comparing nine~-block cells with 6 edges, the program has correctly found 
that the upper left-hand corner of the subimage corresponds to the following 
x and y coordinates, respectively, of the original image: 


ie 
0 


Km KKK KKK KKK KKK KK HK KKK KKK KKK KKK KKK KKK KKK KKK KKK 


KERR KRAEMER KKK KK KKK 


2 and 16 are the x and y coordinates of the original image point 
that is the upper left-hand corner of the subimage. 


running calculate gradient on the orig-image 


running 
running 
running 
running 


calculate gradient on the subimage 

select threshold 

calcualte_num_edges_and_unique index numbers on the original image 
calculate _num_edges_and_unique_index_numbers on the subimage 


The threshold for this run is 0.35. 


*subimage-five-edge-list*: 


Ons tao) Olea (12.5) 013s 5) (i) 6G) (12'G) (10 7) (11 7)) 
*subimage-six-edge-list*: 


NIL 


*orig-image~-five-edge-list*: 
Gels 3S) (12 4) (14 4) (6 7) 
fea 24) (15 Pry (13 22) 
26.353) {2 35) (2 36) 


(9 8) 
(14 22) 
(3 36)) 


(8 9) 
(26 22) 


2) CG 15) 
(1223) 


(30 16) 
(73 23) (0 26) 


CY 19) 
(O 28) 


(Zelo ee Com) >) 
(1233) 


(1:5), 20) 
(isa 33) 7€25 33) 


*orig-image-six-edge-list*: 


mT (ome So 7) (7 oye S 9) (16 13) (17 13) (16 14) (17 14) (0 27)) 


KEKE KKK KKK AKER KKK KKK KKK KKK KEKE KKK KAKA 


By comparing nine-block cells with 5 edges, the program has correctly found 
that the upper left-hand corner of the subimage corresponds to the following 
x and y coordinates, respectively, of the original image: 


2 
16 
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RKARHKKA AKA KTH KREHHKEHK KKK KK KK KKH KARR KARR RKRKERKEH AHR AKRKRKERNKREAK ER 


There are no six~edge blocks in the subimage. 


Le oe ee eee ee ek ek a a a a a a ae 


Ra wwW KAKA KR KA HH KKH eR EH KAA EK AeA KAKA MK EKA AKRARRARMKEARAKRKAKAKRKKEKRAEK A ARKEARAAKKEE OK 


20 and 20 are the x and y coordinates of the original] image point 
that is the upper left-hand corner of the subimage. 


running calculate gradient on the orig-image 

running calculate gradient on the subimage 

running select threshold 

running calcualte_num_edges_and_unique_index_numbers on the original image 
running calculate num_edges_and_unique_index_ numbers on the subimage 


The threshold for this run is 0.3. 


*subimage-five-edge-list*: 


((6 0) (13 0) (12 1) (16 1) (5 2) (6 2) (7 2) (6 8) (14 11) (16 11) (12 12) (16502 
(15 15) (5° 16)) 


*subimage-six-edge-list*: 
({72 0) (6 13)) 


*orig-image-five-edge-list*: 

((1 0) (11 0) ¢€11 1) (22 2) (13 2) (13 3) (11 4) (12 4) (14 4) (6 5) (9 6) (10 6G) (Gee 
(10 9) (11 9) (9 10) (8 11) (26 11) (9 13) (18 13) (18 14) (23 14) {16 15) (17 13 eee 
(30 16) (13 17) (14 17) €12 18) ¢€13 18) (3 19) (33 19) (34 19) (35 19) (15 20) (26°20); eee 
(2 21) ¢€15 21) (32 21) (36 21) (12 22) (25 22) (26 22) (27 22) (12 23) (13 23) (ieee 


(7 26) (2 28) (26 28) (0 29) (1 29) (34 31) (36 31) (32 32) (36 32) (12 33) (13533) 
(2.539): (35 SS) 36) 225 35) 


*origq-image-six-edge-) ist *: 


{(11 2) (7 7) (8B 7) €9 7) (7 9) (8 9) (16 13) (16 14) (1 19) {2 19) (32 20) (14° 2) eee 
()4 22) 40 26). {1 -27) (1 26) “(2673512 Se (2 son 


aaeaRA RRR ARE K AHERN K HAKKAR AKER Aaa aK A KR ea RK aK 


By comparing nine-block cells with 5 edges, the program has correctly found 
that the upper left-hand corner of the subimage corresponds to the following 
x and y coordinates, respectively, of the original image: 


20 
20 


Wa RRnRWER AR A RA KK RAR HEA KK AER AK MK KR KR MAREK ERMA EAE REM KRAA KR A Kee e RAR EK RARE 


By comparing nine-block cells with 6 edges, the program has correctly found 
that the upper left-hand corner of the subimage corresponds to the following 
x and y coordinates, respectively, of the original image: 


20 
20 


KReRR KA MK EKA KE A KRRKRKEKR KR ARAKRAKRKR KAR AKRAKREKRKREKRE AKER RARE ARK AR AKR ARE ERA KEK AK HR KER AEK A KE 


ROR aKRKKEKRE KR AK KRAR RAEKRAR KR EAR KEK ERKRRKE KARR ERK AREER HEAR ARR AR AREA AKER ERK ER KAR EKKO 
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APPENDIX D 


USER'S MANUAL 


A. USING THE PROGRAM 


To use this program, you must have an image file that 


meets the criteria described in Appendix A, and you must have 


a Symbolics computer with a LISP compiler. Follow these 
steps: 

1. Load the program. 

2. Type the command, (make image array "<filename>"'), 
replacing <filename> with the name of the image file 
you want to process. 

3. Type the command, (initialize). 

4. If you want the output to go to a file, type 
(epensoutpuc, fire “<filename>"), again replacing 
<filename> aS appropriate. NOTE: only one such file 
may be open during any run. 

5. Type the command, (set_up x y), replacing x and y with 
the coordinates within the original image of the 
subimage you wish to process. 

6. Type the command, (process images). 

7. If you have opened an output file and do not wish to 


send the results of any other run to that file, type 
(close output file *fd*). NOTE: you may send as many 


runs of the program to an output file as you like; if 
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the file is open during subsequent runs, the results 
of those runs will be sent to it. Also, if you fail 
call this function when you are done, you will not be 


able to access your file. 


B. DISPLAYING AN IMAGE 


To display an image, use function display image after you 
have called function set_up (Step 5 above). To display the 
Original image, simply type: 

(display image *orig-image-array* 0 0 *size*) 
To display the subimage, type: 
(display image *orig-image-array* *subimage-x* 


*subimage-y* *subimage-size*) 


AG: 


LIST OF REFERENCES 


aiimiiaw i ance bDermoce, Do introduction to Artificial 
Intelligence, pp.89, 99-100, Addison-Wesley Publishing 
Company, 1965. 


Sando, J. M., "A Texture Analysis Approach To Computer 
Vision for Identification of Roads in Aerial Photographs," 
Master's Thesis, Naval Postgraduate School, Monterey, 
California, December 1987. 


Roman, G., Laine, A. F., and Cox, K. C., “Interactive 
Complexity Control and High-Speed Stereo Matching," 
Proceedings of the Computer Society Conference on Computer 
Vision and Pattern Recognition, pp. 171-172, Computer 
Society Press, 1988. 


Hartley, C. A., "A Computer Simulation Study of Station 
Keeping By an Autonomous Submersible Using Bottom-Tracking 
Sonar," Master's Thesis, Naval Postgraduate School, 


Monterey, California, June 1988. 


Encyclopedia Americana,  v. impos i¢e2tOnme, Grolier 
incorporated, 1987. 


Newhall, Beamont, The Airborne Camera, p.63, Hastings 
House, Publishers, Inc., 1969. 


a 


INITIAL DISTRIBUTION LIST 


Defense Technical Information Center 
Cameron Station 
Alexandria, Virginia 22304-6145 


Library Code 0142 
Naval Postgraduate School 
Monterey, California 93943-5002 


Department Chairman, Code 52 
Department of Computer Science 
Naval Postgraduate School 
Monterey, California 93940-5000 


Curriculum Officer mecodems? 
Computer Technology 

Naval Postgraduate School 
Monterey, California 98940-5000 


Professor Neil C. Rowe, Code 52RP 
Computer Science Department 

Naval Postgraduate School 
Monterey, California 93940-5000 


LCDR J35 D. 7 Wolfe 

Executive Officer 

NARDAC San Francisco 

NAS Alameda, California 94501 


Ue 


No. 


Copies 


2 














Thesis 
? 
W6S35 


ec 





Wolfe 
Determining the loca- 
tion of an observer with 


respect to aerial photo- 
graphs. 














































Ree & 3 tre gaa ran 08940 083A eee ar at per . ote 
Toor enje8 UTED FASE BoD) Foe 98 = 059 0 08s Rab AcE HOD ye EE = ° 
DAL GrerteLh2 6x6. a tasty AB We, 70. sre Pw Gab. OU a CoH Oot oye My -Ox im bBo bat ofa, " 4 Ao ° . thesW6935 
Tey hb Pre err es est EAC SNC AS of cn ehe tS Wee AGAR -ADive os ho@ oft ; re j 
mie BF er eoer yo » (gaat 4.6. EG 2 I IE..90 92H 1S Bad. GTM tater We VO pear - f.¢ 0% oP a 
Seen CLL IAS pSV WA SS DE SOL NS CRED Ree ne tine glade -o°5 itegneee bern AEs Determining the | 
5 enchant Se ee Bt eh. 08 tgcbad'4, 4-Pr hone > a ht “ ; saher% hed . ‘ j ) 
Lan redrepon-tane GNoh nAaAS® cake yh Bar de GG A-n02A. FARES SI ASES «wah afield 16. % wie 2 Phew 6S © a, : g the location of an observer 
iedtysb 0 PB Dem aK DihSird, God C-8 uate DP H FOSH, Pond, 035: WD Wheto nh) oho 13.1 ey Power a eae | belie is sanlaeriuaar es 
Ri ear aet of MIO Ee OF ath Anh. 0 Ph Se NYE APS oA QOH EBD Mp iee BA tn FAP 8. beh 6 SP telee WEG yh nits: of, 4 > if { | | rh nT T boner 
MAE ead hela R24 Ay Sole ty GER ke UM 2a LS AS, Reds § An Totend 142 BH Otro teoA” shel <ufie yp BIDS O59 O°% fooler ; ill } { 
ARBs Catan sf of Bre. %2% poet 1H bi La FelpnQrr.9e 54, ihe oly? hal 0 ty tip lay Beh.s rh BA oF § et he are AOS ee ee? Pe rd ee ad. : | 1 | 
SO Eh PbO PhAM A ATE ADE G9. IE Tah Ya Gord 4. Web UP UB FoF 27d AaB 6 My. P ES 0 WD To DERG ok OP SH ISH "Ohh WO & , Hii | i] | | 
per Lh; er I ee ee ee 4 nahn Oca HERD ng © A DARO? hi GedeGa! BeMitr el Obey el rer ehI Leh Ann) Ln z oe 
ALD RTA Aha te? HS Bay Ry. 2 AT Ch a RA reel OR lg nO ys AS G1 UMS HHIETING HFT G Orn @ f ee 8d ete-Bial soho : ; 
Aghot py Bie. ES 0tn? 2h BA lt ah pte FE a) ced ammenaelt asain {SAP pe FEU by PAVE Agee" Se Ket Seed? $eth © fe'sat aod F | | | | | || 
ORI BA 6G IA MR, IBI ST MRAM By &rmne ROO =m 0 aha arts terete n pater ty lode d mS nas. coveneras Taser | | | 
Mate Fs! Ce eh AGED a te Col Darah ne lak ea thn tot OOM Tae’ es heed «44 Si Aaiited: omaheg SO’ Kale Be O Of Myst S we e% | | | ial | | 
pasaduresd senpaets-¢ BES AD ohh, Otay o& corgtee hive a, bi lg i, He DASE Gs 


28} Qicbhren Bendy Mais opm) tbe, t 80,0 ap deg, BN f 
Roll ber # f H Heh. Pie Kaehd- ds ORAII sl phetrrteAe Se ott tcth Dh aN Were wes Cos. 
Reno Pobotg HPO VE 1 Roe ROH. BH PPE COLI EE COUTTS REEF TET fore? 16 te rer “Fl $8.0 teh tar wa 


3 2/68 000 Sis27 





OF br4so hittin th * 2 Wo toe : 

Beene eee vaatgaaated Weel. Ue SDL ADELE IES to Mbitali 1B Ld te oy PON AD De Saree tes veil .. Srim ba toe Bf 

naman a terare nos statereroe 4 Has oe Obs? CEERI seep wy rete be *: ans Kish oh Sab eye ; 

= Oi oes a OER) Of, ele San Da etig SCARED Ea 1s Wet D-Boy SAM paper Pett dee Gt 4a whf- $ 

oe ah tae ae aig tee AS A Ailet WDNENS WOM trAsteRZE SohA" ¥-O4 ork gry 203 REMY DUDLEY KNOX LIBRARY 


ey yee, ta ee ee ee ARS Av DAM party MOM WY rteMaeht if aha! oh0 BAF oS wart a Ooh OF Ly 
» Col rR Ac $08M F-42528. haan’ dots ent Siete tena tnily'h ae ty Ch GARE EDI tin of Sse Gdeytg’o 909 ‘ 
int & 0.9 Bothy 8A RF RZ Se 0G aba Ke Od P Ps Peet a Be oF HE RG HO. Bt owhe 92 ph eh Bo Bohrde" 

VEIM PIA He 8) AREER Oy hectic! of hd Bowes hoe igh G60 Ae bo WOUND ST MTR ral MB» Eq Kahiharct.fos 
Sid ar Moe Fw © WG Tr hy aes pop rp ee OA Ades aA Re OA rharbrro% OF-A48 005 hs RE Lf -v9 4 ‘ 
09S 2k 0p MBUGEEES Tv oto sta tribe ho Brits oll Wet Wy © ph Ohi Kt heh otra 1 PN4 Red a net pA! 
OB pen, ae emt AFBI» a: Sa etal DS UKO4 RA 2 oh yp ish 1S Gh OH) Pe he RO® Df "yblly Han 60 Dohrn IMM a hn SAS «BDF 

















Serer 2 tt ea eariuethe By vi, pA nln = AE 0a Ham eYnc Aah Qa Bot ds wes Spue 0 OF BO oer 8 wena Mette M4 « i 
rh dt-R? pn ea Ob yO ttl e500 ee tad OM ME Ge Oates Ppp Ma taliatind Fi 2IUDDEP A ede Heise te oom SORA Lt tabeb Role info. Pole 
p eT er ae ee ee ee er tee Ce : 







ee ee eee eee ee 














sey Fa ms CARRE y Sel Katy . 

a hoe eT ed Js 0G A104 0 = pet ee LB VEG SRAL I, TOR, * eet pFAha edn de® oe 0 rar HITE Yary seeniid'si, Rldg eh gt 

praee , @ 2 Gow Cae Mp Mp GEIS Me BE ee ald a pa <axeebuk, canara tiie La Pe Oto’ @ilmut eer er os ae ae.G<f ots 

ies Abst OMe Met 20d bile a tes pet OLR Rare Hot A OADAA.S OLN s enw arpa fpitealy A Rema H AD ie Be ety Shay are a we oe eee eee acetgr 

cues Reds Co bhiln Ip tate heal - GPA Lom 0s ih Oa Maher me teil B fh Ost oo Fs Fay me hal oeO oF PAG Fob 8 a ot Hed od tpi Ghd pore © * ee 
Dew E ALMA oh Mi eRaRal, Ay B.-% 92% 0%. ype Pen. Aad Bot om gh 8 iBl Sic ck ohh, $48 S00 Py ‘ 


be hoe OES OMEN HOt «MAHI OMIT WS ells “19 GOOD HAY 


Pooh oO ya ELE 05 ertemt, quem Ay CLEA 


ety Fete ee 
ot. Fah a 164 Ba? 









Ly ee ee Yo 
bere J Oe a Haag pe ae Ontapo Bs 





O00: pea © Ppl 





rE a eet ee ee ee ee 
PED 5 Ls Yorntnd 








er heene EL hohe a © RLV en 

as tio n@aWe Lote ty, aa oF 237% & hx *. 9 OP Me Sn Reb co Re Rips AC Inn AD, OY Dy HOE ole YORE 4 Fe BDF OF8 WHS ody HM Perera Ti at tr e 

Pentre AOL MINOR 6 yd GRE Rss Col ARO GT HD Now oe Th DIy: GIA emp Rat Dt.0 Ca Psege® oF ohieb nate! » realy hg B 0° CPP wy AA oh 1B elein hve tem ede chet 

eee Lal abet pecbebengl aithe pera 04 Ne AAR OME ae a AA Hethesd O28. tah eatipinn ds 8 a Ge S20 rie 84.540 Fm Mba ket KG not Be oth he lh ips ; ; ’ 

SUE WS LER E Ae: PT Th pedesi-ind, at crt a denaeiediptetrd neha a had CAG LIL FprGer gh grr} ae bi hmn ger wae 56 .eht es , ¢ 

he ahi ved es BTL th Reboot Ot A ayhel ar Far. 0 ts Renate be WOT? HELIN: Radiol i, RS Hertprtia Ge * 00> F. OD PS Gem td AE Ye WA AGAVE 0 9 OO nh ot Pf sae 7 ® 
Aa EXONS F000 tt OTA Tarp AGF ip Oe S hAND® ehODs Ll) -Hodot ality 4.0 oan fp AP amle) So oe 8 . 

‘ 


OTT on, Co" of ae Tecate yp Mh? ow 


ean thet Mn 7 ata Eh ADGA. ter 4 F LPM g ARSE Mien Ket Ite POI pO Oe HA GOO IDF 0 ow 

eee Aa ell TEE Pte meyprw Hehe FAS Oh TON Ot tomots ob 0e mel p GaSe ht Oe ah 4 5 © Oa edne uO Bo MOF.06 OA At PATE alo 19 “a0 S * e450 e Lee 

Mpg nh she hitee My SD Upp Me Fe a el Or O RSNA EA CER AeG 9 eB Me AYO Al OBI e0 > OT TH 1Q MOBO ahag. two MEAT A im 6s Gc bretod *, a 

ores OME SIS AID LOTAY ROGLD BOY Koh. osyirs@e DVO MHEG 0 OP PAS YF At whe FE BE AMOI AER MES. 78D GM plats oat yat« york hint ® Soahcas anime é 
be Fa ataatate HO SH 2th 4a : 


here Oat RE WE of Cn A wel ai 
ADE ee 28 ee 2h RPL sim Rawr Grrt tat hh PF 






eta Fiat J BADE! HyPil “OO a Qh ob 284 bo 
ee Aig Wo SUMVOD 1 GPM OLE “P wT haw Sea ohe 


batatQerdMieem, ¢ep ee Cohod 











Ae ediah Ohh cae MPte Spee ib: Otoetan bln pane b 


va Be) feta 


0) Oot Bbaace Gab et 


Ordo H? Pbare date? ¢ 
a oe aha 


t Yod A 












52d gm nudin Oot whi anes Breine-h kep leh ASM 4 gm TB ROS Aa Rol ote BAM HO Mes npFanth a Parnuats Shrine o% ‘BE eetghahrs biter we tate? © Som ta 8 
Dict a Fitsm On git ants gh of obo Rr: Wh GF -” aFp ehh Ie ¢ ‘ad etalon Cp his ad «ferns of Ay bbl? AW OP sagt, af api ves Witg Me Safe be . aa 
wR me i Loe aa Bh) Hee, ere D a hee DOPE? ode A UUSO OM DNR FOG k a Qe PD HrkoP eb grgane “ads me e.o #e * ’ 
tw vahat oe « pant 7 A, Ute tae bed 
: he 


nteok matt SREP Me RWS REIN ofa Gre aie MAPPER FF eRe oon, C94 Btn oh gn 
SO OF ONL eda Oh ee « HAG MEWS. S> Portal ahgp-rot = tot 
























































Abe BR. Ri wh 
a 











lee hot OF ihn t 50 BO ® Oe ¢ Asa Bark 








































































































































































































































































































































































































































































































































NTR ght OE ooh, arate * 02 6 08 olny ate. 6 9 Us tenon EP rete dete a ay ath 0! o hs? at Goa et 
permet I Sehr a adn nt? 6 pht-stiohe, 206 tn th Alaa otivet 10 Bato Rh 2.8.8 y AL, 20 etAad 4 bot Dre ’ Lg 
OBA ae had © PoP, O4WwhO 4 bor af bier’ Pein Si titer tres ne Salle nad CW ee ares a Peree) mabO1 What oR) HS byt oF oho Rh Pee are® MA gems 
een 8 OF AeA 2F AI TMV RS" OAT AE Baty hata Ge ew Re ee Om od comb ely hedetiel ot tree ows AMS Oho! 8 " D 
ee lee odal > alse tat» Oak Polttoh OF Dee AB: CLADE Ew Smt Ort Ahh Calf’ pe 26. .Catnemg? cae oll 
pak. eats 50:00 af > PORDPS BA tater ae etm benmenine4 af tomet.te ee at O08 FOL.6 Ola deeetprine waele ae ’ 
aA ont at Peery ee ty 7 ote te weraeg? aw ne Wig maton tate” @ tail a ee Say Je o' eheeng ab st beta tha » 4a! 
A ebin® O18 ptt OBE nal Aahe 00S Mh o8 Mahe DAR! Mog, ¢ a0 Mor abe e8e omy ght Cam BM ba fay Sine satel Dr. WG adhe 6 A200 ae eR? SoG 5 + 
Epi Core ham aM of 29 ht geet et, GAR! Bade 2 OOP - PALOMA AADP.» Sn OL ony, © -H EF neue w? 2F.JAQO OF» oh oso Tats Apel A.A Aer %F Shor e 
Cade ng Doms oo hf anmiets Gro othe OO AO ath oF ae hotnEee Sot 15a hel dea Dy gma w- Fo B a Vt Ge BOs Pole Be Oak? F.9 A tLe VIAME O50) Hom 
00 wn 9 en a ee ats pt POP EMU eh Sales ls DcMetics ptiet DAB. O88 ARM Eh UD Hf 10 + Boho? OF ner se hohe wf Cp agp 5A Bengt - 940! Ages Re e 
moe Al atearntes 9 pie fiaknth: MAN pert otal oa cue deh 19 6aterd Ol og Reh MD Eoha es @068.0 oF e-0 Mee oo wat © Hohe ate 8O:'9h Bi als oelte® 
ag oes an a BO OF As OarD.1 Arian ot AE) Coot 9 wedd OG OB OAT OF SEAT «Hb NA nae wont Le tr Oe ee ed Me *¢ ote wat a 
Cas ehh lean iat ety Mhdin 10 Anal mie eas blo Cuter .oe LE OM . bse et OLE thd? CA MDISID Hof 0 ANS Aig ght. QrOp" 06d yOo* peat 0 eee Aes OM 0 ets * ® 
Piel ayrncereran at Hf ami hed wae e fae Sh ge aa el inergn et: gig @ Ah de AEDES Fer, ot AMR ADAG ads Diba ah a nO -0 et anoin’ a? BV 0% Rote MEM BSE Papses & ® 
Lobe geh AM pale CDILT 1M. OMS OA ORL M, om BF O° Ra Geb oRad pPePs'e eRe Senared. O50 ended BOE oe BETS DE 0F > BAH Ent om.%o lam f tOM FFs t ® 
wr Sn Ta gah Ul Onn ty PR PO OSA dS nM Minh Eh -Ote ¥ 0? @ aty ari rT ee tind ania Na Aart Beem & : 
ctor nraanect ice nde "+4 light g¥aiems tern let af, ° gS 80 bet cone In hot OB 9* Spt sta Rebed 2 PEG Aate er »Z ay P) ‘ 
thr eeeted Se AKU Oe OG ia tart 20h te OOF a= 1 1edipeinl 9° A Pt pe ee em Teh etn tah ame eed OEE HOt CeO ager lt HT ont OT ibewtet @ rah at 8 pe eter? ’ 
ms 6 adore emndy OO Aee Al We Ee KD Queneees AGE aeer MH Cas od. dowry th lov ten Fatah ot main € Aamo Bh son to rid phasrncart wee Nebin ovat % ° 
Anne Rp eN AL te ath vide of ota) pane aRe hetecwsl al, BNC S eee eget a mel 9p Baked dD am il mg Oe phe AM Oe Aut 0 es oy yhteok 
ep Cee RA sinh yd Re ORM OnE a OE Carat pets are Ba a epd ACD Ee Fo) opeod geri - We, Peper ee ee ee Oe ee ee ety 
a Bon bo Soran «wo ern TreS ete FUE NLM lat mK 9 ive rR Ont hae SAA LO Pht Oe BA, OD oath! Cmctig? 1 IGS Ae) ah > 4 - > OP ap 
Pee shat amends anrigmt arte 20 y Om Feset phate weRaQetatst: mal» 2Grh 20 Baw & O44 oh Hof, 4 Oe we ee 0 ee a ee (4 2 0% 
Chem Satee ares omed bl ¢ wh etee ha ee tatirn ted $4 ue. mm mca? may engne f AMG AGAMA OO ebe YP INA. 8 8 et edlo ° ° ‘ 
nw automat’ rqaptsr tee { BY E-9 Dine ta sewete Ae Ooh e test e@at '-s” NAS 26 RAL, 20 Ci peh A Po ORE IRAE HSH Ly AG BEA CO ‘ 
at aren eta Fut ge chet et ot tate. a< Das Wi Ao are per DLS tat yet i= emp lpg re apAgrg £ © arr ‘ 
one ete aed gy toed olatis F +6507 OMinte Habe & Pet 2 ‘ Pa ed dee b nM *e' af F © ® » 
atte gt 2am sal etree netat He 6. hone 2e eRe gte aw temnss 4 de pate pe ul Pena totamm eat BbA ew Otel or at . 
0 OTN be Bye joget Gf Oho nents ds Rewe0 son ded oattttrel BS CoM p 09 8 PU UEADORD ERE Foetal 060 Ee ans © Mi myrar-PomutrF.8, t 
eet aang d 9 © haphe” 9 a Gnd tet 28 mir nae one Rabel BF ® v0 8 whaler oF fect ae Pe ee ee ry et 
ear ihs CotteMen= gr vneela Oe 8 WO Rah ie damed Das etre Mah ff 01058 A Or e892 em. Bh 04 e aodig dettt* + enum 4 s 
2 stele: a nt mo Ow oo oust ge @ew> etpae. 1m het ateOahn One Ete ered Yield he Sebi ie ag i 
0 =. ab ebt simp ef BOA Obs An SOME (Cob oe Tot gee Bate ase at pins darko gies Ae ematyen +h ohot POP Terry meet 
Weta FR SO oh eiemeMeD MeL a7 od ores aS > HOF pO Hor ynawt ee Pare ee te te AgPartetuter - ber 
f A gee gs Hk tently MOR eh oy 980 4 Oag AD 2 Oe aE 4 00 oF O08 ok rer an oe yg fen bats Pt 
ras ameodie® Aa. gan Vim id en Me ate? arr OP ati shSs.% a9 -2ttioRat sofgrp +06 p88 ema te Reet oe Gee aman. ‘ord e 
te het tod ee ee ad gp Qa OS Oo ett GR oye ewe Mikbg eh 1902%. So var ABs antateeny Sb q tow He gad li gar St dgied* as metal 6 «us ° 
jade Piety ary oti na ah aor phot weed ale on Sak 9 igh of eh ol tnt O Unies hate UNS NeW AGTH Some oo wae of oe eng oene Regt éa « 
aa? toe de red bet Aeon art a bnO0 02 gente ol oteh oo tnet veri 0 Sp 10 26 OF 02y hehF mGO Ms nds 29 LTOMNS Mp Hrh tbs egeeror a ae 2 faietne 
fr sow baw tee Ay en end oat tt PGR Ay gotnigys «da: fp Bw Ansa? Oral Bin porn SomeMt 4 AG" ON ry ee ee ee ee ee ee ee ‘ 
oun Gof sen t.sbisen WebeeaPhence 2240 4 whapt Died phat Oe ODEs a9.b od A Bye PER O om ue 
Burst a Fe bid) org hs Paes 8 aethes OO~09RSE states Get > on aihtad os ’ $ 
error vee Teens arat Fe any tel eat hd 4 ekg tue ; a Ze a 
peek aed A otere re SP eee ery rere fae tee “1 are 4 ’ 
j oem OR 20 An 4 weber, Rah -naeetyes ge Mt Bowes fe ytoee- ated! Cp » 
Hee gt em Og aweels 4 0\e shy ns? Ol wognatabAar Pabetetaee wpb fed o gin phat de! dee *s i, Uae 
mint OB FOG Wide 2 OM Bott. , edi prgatg “AdAmed graedtarnd ton By ponte tads? ot hiaker Age 4 e >of ° 
ope at agua ark unl ig 1 phe Date ea oF incimy Rptimglahdasint tte sinter On ur Phe ote bd, 2 19h ~e'se mae tener ae tgt 4 ya" we % 
ee ae eee rd Le © 0 aun se Sheth at arb ererniae soeast= AG.re “A a4 wetdee can 10 @ ue “dq * alee ere er) ere ae ee ° 
hes 08 aap bute atte - ia Fes 08 9oG bf ee tare messi’ aor nye oop tate t bo An, , sa s n = ® ‘ 
Sonne haw el mi waite dni ot CAMS AP gtrOare orael.om bh = sceplia F Vrod Hate hate: Ante ne os 7 : ° ® ee 
and am a wedead inital at gin’ Veet Cee’ a -wafe Diy” @) 28 euarte t: 4. wf : Pa “an ‘ ’ e 
ee ey ad ee et “tee shee hoe ane 9am » . Pi 4 aa 6 
Sek ef 0 ik eet AO Pine chia igh 0 ee Fi at al Fas we of ABs os UT re Set On. he mt ehemory oo ota P ’ 1 
ES ect ote alee Te oe gt BN "1b at 'o8: sWitdtbegennaael of +5 hee oad epratior Ong cdatijes? e ye + Oa ° ° 
Enid det ate Sere awe i A OS cae SF ae a Le DARED gk wi d= tat oO oe oP a) We Saye q o' . ’ 
hd geet eames treet Whe ear yk: Tee oan Puy Od adem , ‘ 
Pee ee WN er ee eo 3 > 93 ° Nag AP ® ° » »? 
at bad ade S2omip ahh ie pte galt dog she ad > hd ° ° 7 e« e's . . 
wa tRNA ol bg) LY Ret AS ham oe od ib 9 A gd a ome oes elee ces eae 
PE ee Ne ede od opett: we D gis ddarne mg RE ws! O° 04 Seam {) Sa F Pray Py ‘ 
ee re ee ee el ee ee ee de ovis at FF Fb oho * $ a ’ 4 Ds 
eee Fuca we ee tage cecdvs wo-ee befebs,sligverwene 8 Mw ieee “4 a Z = a?) ° 
PASH HM wet? he ALBAS Ie Ve oo gtere: 208 = Sr rae oemrate of a a a 
; J tind 0! BF 57 LA, 1g gd: Penta “to barsest Sit F vigtire . Ay ‘ 1 ; ° ‘ ? ri ’ 
Delia at OFS Vo iatel & Yio, asote So ot yimig hs w Sreree i | ag ME om ware P : ie | a 
we Wd Ash “o ‘ge gedl grag hte Shes ae AF etnias’ 6% ~ in oe SS Te | pqchearat)-® | ahaa? oS iF - - - m 
ja aight 30 pede RS ace bata ag tae OF Fat GENE ye BS da gn gine? i i Ju?) we ‘- . 7 
ip hel BaF Bele Pe Ar Set at tated ped yas) “ 1 tM eh vagal’ 000g! oily as, ew, eee '° mht A 
Bead g imal Ot ade g' wie cada fe Gh deo eae” y A Aa pdet pm 9 a wie ty gigepae tse of ve al tet CY s P , F r . 
eee at 0d &* Sat. te oA hy wae a Perry ft esa 4 ie iy’ sunt ow x a a . F A 
we MOR we we i ed .) yas t- e¢ a Fy hae 6 ‘ets « ~ © a ° 
, 2 Fede oe of 7 gchomt of ee ao? 7h YRS, outta tees 14 Ae = | ge b eyus® = 4 . aa 
83 Swe Blagdon legs Bid BY. ow pile Bd ye 9’ ate 0h eo ad @ av tg! cael’ @ ange a rim # ee r) > 
Fore at er ggati dh yo ig hes: r ide ite Hae. ita $40' 27 7°? wan We ¥y as ' a ‘au fe 5 ays » ® : p 
LF har tee atthe 0 ofa Ap nisearw eo Wiel as” a : Party : : 2 4 
rier ys tart ot he os UPR o gu. shoe omakgeg oom FF » wesnsed . “s vs = i 
: ‘ r= 3 , at perey * ‘eu: 2 At pratal * : 
YA e 2 . ae pes oF 3 fae? a — = P : 4 « = 
; Pat we 4 *g?>9* omyt bie tite Z ag Pia B.? = oa a 5 
wh a ee Le ee e : 
etry mete oie ral f Pod @ 1B Oube? ( : 1; “ws x i ‘ sk 
Thane 3 O° R S24 2e job Poet > - 7) % . ates ayats i ie 
$A For at MS Eghata tes .2 « ¥ wy ” ¢ . “ 
BIB Brg dper’ lees t2 F o} . aa . - . 4 
"RTE Mk be Sel Bo ass ¥ tie “ 
See Prin tas Sf a  . a of e 
Uy, a? -_. 
e e . 
. d ’ . « 
J 4 . 
»?* * s ° vz a » 
: a J «t ¥ et 
‘> y° x F: Pe) . 
oa ; oe . A 
We . d 
"Alb 
Tit h ¢ B 3 A 
Paez ee - 8 o ‘ * 
niph as 5 ; eas : t ig ; 
<6 ASS of SH Bi ry A 8 i, + 
ure ° A 8 an a) 1 oF 
34 a. 8 eo: 4 f) te eng 
AY 4 are . 
>” . Ph ¢ 
« e .* @ 1 ‘ 
m2 he en oy * * 
. 5 e a od 
foe ° ° . ov, 
. ° ‘ a aN 
5 : “ ° % % Lie 
ww Pyrs Ly -? 2e*srq2 "ge ye,* 4 ee § . = 
PotD te % a o® . * ry “4 
ae keh" i ie ae = 
meee t PEP eg EWS ae; © +e - ny 1.8 . 
i = sm e Lea | * -:- . . 
i = i SaFne “teres? iv % 54 Py Se ‘ . é ‘ 
oa ae AR eee tt i tye gay. oS oR 
SSyry ee eet ee Rhy 28° tec Ace ohhh Pare i he ' ag? a a © ® 
Spano teripy pert) &'5.%r Syatyeeeec rest eryeged espnnty Ub .9 eres E ; 
*ore ? Fes =f 0.8 £ ee ga*’ “a '9") >. “S49 73° 4 ries wary ’ 3 ; 
7 of NST POF rare sch iuny a id . a5 : 
sghecue ‘ a * . $ a 
a9 74. . . i 2 ‘ 
3: > ® » ‘ 4 
| . . & 
% viel es . % 
eared i a Ba 
Shetd , e e 
ag ges oh ssades ee: F °° J *y < : ; 
Mmrvins . . ¥ ¢ 
tatters rv a / ch : 
a” waiter ng’ . q %, a y 
S eee at . 
. 9, 5 ‘ b 4 
% ® 4 2! a e 
J yee ® 
a . ee 4 oe: 
* ° ae Py ° ‘. a * 
Ly 4 Py 4 rr) et “a oon r 
se Fath VSS Le Fayay Naty . Lyre ky 0% ° cP .*s - ° ee 9g A] 5 e 4 “ 
AES TLAIMS QoQ Twtele gy Oe Ae wane Tyr eep al sO Rees ”s Fs ‘ 
esd Pafywstye 0 9ay,> APs ibe Us th til on ae, Pe : ‘ . e a Gy, 
TO ae es te) He - toe tg whi pore . ’ e 
9 pegs Meledare atm mrtyes bee Steve 8 «oe ee ves . ‘ 
yap Ja dy yvece sg can at» Seema are ta ace Pg ene vei “ ’ 
wera puedean eye f A F F , 
to Pay et WAS gore, ® . ® 
' Seuaus ary? % « & s ry 
i-a@ hoe 4 
? 2 J ° ' e j.° ony 8 . . 
osama ty Order cease ft ty baie geese rg y 4 é ‘ ' 
Pa Lit ee tL | < e Fm ater "8 S«¢ * 
St ne eee es sotedatware ¥ ai @s ‘ 
Sy pooe ry fe : , , PP we Beh! fades q om @ " ° 
Bs ROO yy eegd- 8 O08 ce TY ORK ok HY Code WE VF A ole ENoree -F ee ep cee las Fase . Z ¥ s 
birbidela by woeP ar gi vO aera rang ue “ove thos 2us08ee 92 A A GM Ra rq Move © ature O08. Ae < “, . . ‘ * 4 « 
Cede eer yr eee eee en WhryIQG!® of ews «Pt eile Lp ha & hb ph Ad ald Pe Tat etnsanetestry 8 acho * ® ee 
' ub gorabyhatert pace Wie g Pree USA SwHE roe yi ow Royle of Kis 2 OES Ue tebae 8 > {ae oo rane L « .é 
So asa te Deen ete | tle: con @ glerye ONp ae vaste sty) ok p.m Hela?. WOES. deeury ote WR ge i iD . we 4 3 Il _ 7) 
wre, sev egal a ae oak Be wd Ye OF Of We et es eel By Ser ta oo ee Es ee ot sdvly G. ay 
pos) Di dered 1 Hy eh Tort? 4 0 Fy SOR yey PUd Bor a uly Oye Tew fed y dota te 10) abrcete, y ate ita 4 Fy a 
yeoman ony meta ta ly csv tah este) SFbeR as 702) Rt erade Ube apetydyrereMere tela g: Hsrutergte *a CON De og 2 4 r e 
as gis de, reg oh Werpederedeleresyleda set ears Sid. g°Grods Pas. Onend, Cie Fe rye @ a's hee Cormg§ ) §_ ey t " 
o ytecalyd 8 ENO asn “Oe nee PRPa Lh Sy hg OSES “MIEN UM le +e aeees Fy te & EMTs soy aly. ® Oe whet a WSS ‘ ° * 
SD opiate WeEre of to Sy nd ) GHP Rie 82020 082 asa em Pe 6 BEY & Os ML A jes . s * “ 
eee Ye a tei es Ot olee Bh vi : i ‘ 
jowlet werk s,F-s ft, aaa o*e ¥ » t ’ ‘ . * 
ofa yey ote whvdcse 90. 7e°Es off dé . oe. *m 8 ve tna a, fb os 
oyna a pSabeaghysa ie gto Patefa® e8 em ag oe wm 8 wet 4 « fon ee 
rs od Varese te Lela Soul yale cwsgs etwigtyl a wedeige wt fmrarGreds af "a, “ery AH 0, fe 8 Me ‘ , ® *% ‘ 
oF edge ant phe RAtysp. weye Fp Sb fle 5 GeHrG PREY ZR DR fetas Fue Pe Tele Ve eile &, , 
pias fee Po Ol eds kd ee « pePahat 840% CHEN orfagecn ide 48 FAY’ y TENDS y + & . 
ee Ope Wgtah ela es Hades Orvra eyes: eoesie by eras Vetsagts 1S fer ot of 'w sf fof age F 2%, ¢ . 
peor Fetayess Garetelelessbe*e yer) %& tube ycnles O) ay wte ry” : Ce | eh oes e "e . ‘ 
GB erg r-Val beFesy WNee ¢! ay yah p boo atari "0. + ade r ¢ fie gure, ’ 
ay ee a oe Ped 2 ee ee aseta's | . “i , 
betwee gg yes oyu StS OLDE w! CU ROWAPEL GT Bo, « ’ ase, otis . . . } ® 
Serer teem Gere UOaT VE! OW) Oyo Fo ee Merge Fe , eink - see . ©« a j < 
. Oe abt splat erg rhe Cedar wst et obs Cottle NM eTRTy Oy 2 “i * ‘ = 
cere sd obyae O)Gusederecyiueg’ t (+ Tanapus:tveed ye su Nina aS Wey ee CoPR wey ca, OS; 4 2% . ‘ S 0 OFF > 
buegryeay es FaTU OCG tale 0g red yl o MERTEN M5 of Ul Oe ED OPIUT Tyre eee EON ey mh Oe angie oP UPe re § i ‘ a | ® » ne « rf 
ral am bie Ce oe Foraredewe.tee Ceppeteatete yl NR ETH PTO Rey sr mee rete PELE Se Fu; Aare Ore « $ » & 
bh eM AT be pea! SEAS cor Fg eee > ol ahs FELT sy Haye eter & ee aeey oto tee eT eae 7% ae CA Ms 
® Bd a= Be OFF otore™ aMule HH ¢m Ararpess fare eg oryee tess hE Se eet Mee @ aseO. ofate Ld Fe *s r 
yack Ogee ree oie AP on er £4002 RT OPO GG Cabs suey He Fy tS HP ECT et +H wey" 2. qu Sie ' . 7 F 
a Seb aes bed vi! ole ahaa tee aperty Marwan ld plese POP ate! ery Qarrey Ta may Os ghee The d. o.' mo ee ome 6€ s ve ae 
Peeper Rat hw og seedy Sets P ary Oui awatgsn by yl uty a*ytenergsy ann} p) DS OAPeee® yoo megs +08 & wane g 
Wr) a) Abo) Cd ok bee Pe eee ae sietgPuredaig EOC EM Sc yin Chere alae | A ale ¢ o* 
Le) Whey een whe? oy WV IEEE! EF rET of aT OS EAD i kant ares “0 apy oe ° ' +? ® 
FOF a8 G6 UTA? hw? 0604 PEM Caralys Py ser divGese LOUSY: oie Fadi) este wha chtaton. Weta fo LP 8 
ty V8 40 of gated 44-90 80F Me? Aedadieytevi tae O* GebrrvneF 1,6 Heth ide" Bho ¢ , Se ° ‘ 
Cree hy Fal wey a LT On era Fa tech U LiPo Creamer elocarres Peer prate® teow ee eh Kf ets . iT of Gere 
CIbP Sry Peli cree retin Og “ede lee eer, aoe a vus me «8 oterut , wa Orggtegyerd tts step Wee | tf F ertca & 7 ate 1 ¢ ° 
udu whut s cals eur eeusearet se are ' ae rr fake Eh Ak Lc he oe iveqd. Mote” "abe & . . ‘ 
i areres Tye. yey eae yt! "88a asc es Oa? agiete otelySe of dhyry,%* WM & Aw ote * . o¢ Er . ‘ 7 
we “at fay Serareresys tO 1 OW ge ae HUNT F OQ ae 4 wu awe e os e¢ 4 
e° rnd dpb eng e Lowe erys Paya *h 0 2 09 {Emre whee eee ; ‘ © pees ¢ a ‘ 
eohy ry bi dung “Hl vPg Se He seee gheis “whede® sty, ’e woh Fide, hoe WF & & s 
au 08-84 Oy re ctl AG ERTL O OE My PhET Hy poe tie: EeGal rove pe es we 8 1¢ oF 
. wa fu totale et Otbte wee ORM Ap OOF ed 4. ¥ ‘ pt AAW OO arn, ry . ‘ 
Oedge gs 2h es hod? ath 6 OF ee 2, oO ming eC *§ GAUGED “4 “AP eyr os ail ' ** at 
wee Wiis ete tew var he yi Paha erat oD qnat y etry OUR Ee ve ou ot 8 eo Oe o,8¢ es . 
Sater usdeb sua hh scenes ks redo avrye’ Bet Bh Oe el p é . _@ ¢ ‘ e * ¥ 
tae WINS TUT ETS 8 ts a") ty Gees a Bhoratele ue% dw @ , ¥ * 
. he Te Pah Severe Bee 17h out hig. BeVgh raves 7) t ’ “7 
Stans) a8 aretorare shkee ore UrMaerervFY Sind CED o meng t. r ws 91 ‘ ‘ ‘ 
syne 5g 10 00\ey coer ie wim sh wer ey WOME n OAT AeA OLTEN «Woe & 4 hom ¢ e 9? F - 
omtere OUT R ast Mikld Mik bilo ee ke ee ke WaT Leehed we ° ‘ . F | ' ‘ 
Hregmseidegvayetgey'e OF efey pogeee ye user ys Porgdyterirremyyesgiy-ostet Bree Hy ar oe ‘ ' 
Pah ehede ere nrn syed Cru eres ot yreh ature le Sarg h ay "spe tery ei @°9°R SU ely hfe Fury é ig oes » o% 
Po eyty rere rere UT any pe Or P0™ 0 Tah! ele tear yw teh OH) Gyed We ren #t an é wr) : { 
ebacoue RIN 08009O SLE C! Tesh ge werk ete rhgte; nT anys hm elyee re 7a Pe LAE Ey ge . » #4 la r @ oF 
ee ty, § OH ghar! ob g ta sdk Sys hag “erry 98 Pee TORE oe he Kyte: heat esl a9) ah Mey € J 26 g r 
ore Tene etl roucang a a Shes wl ehctyper shares wee terg eth) Yor eles ‘ j : A 
Geer y MPU phar yR le Tah VODA Pag yop Yee ROTEY Cane Vig (hey Sve gry re’ 4"®- ‘ i @ . 
tv wig: OUTS CP a Pol &: wl edy oF gta, of Um’ Oo ay 8 theo shoe “G2°% gS bt Ru Se ot bt é . . « ® ‘ 
a COLON FE! KNOL CHEE Fe wr Mente PE" eRe DG El dIv a wHN Te OFT Hee vitiae rye 1 " ¥ FA 
Pio ie Se eo ee eg PoP itv eOkueye, of ahy *~ ri ® 6 ® ’ ° * eo 6 a 
Cand Le 1) CMG OW Rs er gmewrae € obo FECL NOES? ehSordnetdcw.- ets tuce: ; ittey fe ¢ 2 
WEN HVE TTHOER. @* WE GEVIN er Ces! Dade Ud be s . a Le) “ ( » 8 a 
aces span wed HEY OUT U8 erga 60g re hs heeds COAL ee ea 1 *¢ oF ' ‘ » f i La ¥ 
WIA CET WLW eT | PULL! OTE OF PP OEG TID defers ioe *pFed Gyre wee? Gaam™ ‘ ° ae : . % as ¢ 
Pa wo eet GY Pitot bcakl oki Maly of thd hee ee eee we e ‘ ie at | « ° ° 
Lofty hd RE ney a7 Ve D0 08 SRG iT Cw WOM a seg ey Dial Oly HA ree ’ ) , “ «fs . e Bis 
oy weeriry © Py ed yeat eds ter MoM yc ed AEE! tee els eGe'hy 0b pre ] 4 ’ ea 7 
‘ate 750k w om. tofu O'ahu ete reM@oeg wiatnen Yeah out a tfete 6 4.ey ® 









































































































































































